Electronic device having multi-functional human interface

ABSTRACT

A multi-functional human interface device includes a control unit and a first multi-functional input button. The first multi-functional input button includes a cover unit configured to receive a touch input of a user&#39;s finger, an electrode unit including a transmitter and a receiver to form an electric field, an elastic unit configured to move from a first height to a second height when a first pressure is applied from the cover unit and configured to move back to the first height when the first pressure from the cover unit is released, and a switch unit configured to generate an electric signal representing an input of a predetermined letter.

TECHNICAL FIELD

The present inventive concept relates to a human interface: forreceiving, from a user, an input of text information or pointinglocation information at a digital device capable of receiving the textinformation or pointing location information, such as a computer, anotebook, a tablet PC, and a portable phone; and transmitting thereceived information to the digital device.

BACKGROUND ART

Text input devices such as a keyboard have been proposed for inputtingtext to a personal computer or a portable digital device. Furthermore,pointing devices such a mouse have been proposed for controlling apointing location of a pointer and for performing a function forcontrolling the digital device.

DISCLOSURE Technical Problem

Conventional text input devices and pointing devices may be providedseparately, or pointing input regions of the pointing devices may beprovided in a location separated from text input regions of the textinput devices. This may cause users hand to move too frequently underthe working environment in which a text input operation, a pointinglocation input operation, and a pointer execution instruction inputoperation are frequently switched, thereby degrading work efficiency.

Another object of the present invention is to provide apointing-device-integrated text input device capable of operating in akeyboard mode for receiving a keyboard input, a mouse mode, and adigitizer mode and capable of freely performing mode switching, and acontrol method thereof.

Still another object of the present invention is to provide apointing-device-integrated text input device capable of easily adjustingan adjustment target attribute having an adjustable attribute value suchas audio volume, and a control method thereof.

Still another object of the present invention is to provide apointing-device-integrated text input device capable of processing atouch input and a hovering input and capable of selecting a touch targetdevice through the hovering input in a multi-device environment.

Technical problems intended to be solved by the invention are notlimited to the aforementioned objects, and other technical objects thatare not described herein will be clearly understood by those skilled inthe art from the following description and the accompanying drawings.

Technical Solution

An embodiment of the present inventive concept provides a humaninterface in which a pointing location information input region of apointing device is provided on a text input region of a text inputdevice, and a switching unit for switching between a text input mode anda pointing location information input mode is provided, thus enabling apointing input operation to be performed with minimized movement ofusers hand through simple switching of an input mode during a text inputoperation, thereby improving work efficiency.

According to an aspect of the present invention, there may be providedan electronic device having a multi-functional human interface with akeyboard layout, the electronic device comprising: a plurality ofbuttons arranged according to the keyboard layout and each having akeycap configured to receive a vertical push input from a user; a buttonbody combined with a lower portion of the keycap and configured to bemoved upward or downward according to the push input; and an electrodeinterposed between the keycap and the button body and configured toreceive a touch input from the user by means of a first block groupcomposed of blocks that are electrically connected in a first direction,which is any one of a length direction and a width direction of thekeyboard layout, and a second block group composed of blocks that areelectrically connected in a second direction different from the firstdirection, which is the other one of the length direction and the widthdirection of the keyboard layout; a plurality of switches arranged inlower portions of the plurality of buttons according to the keyboardlayout and each configured to acquire a key input when the button bodyis moved downward; an electric connection member configured toelectrically connect the first block group among buttons arranged in thefirst direction to form a drive line, which applies a drive signal forinducing capacitance in the electrode, and electrically connect thesecond block group among buttons arranged in the second direction toform a scan line, which receives a scan signal for detecting a changecaused by the touch input in the capacitance induced in the electrode bythe drive signal, in order to electrically connect the electrode amongthe buttons; and a controller configured to acquire a key valueallocated to a button corresponding to a switch that acquires the keyinput and acquire a touch coordinate value calculated using the changein the capacitance of the electrode corresponding to the touch input,wherein the controller operates in a keyboard mode in which the touchinput is ignored and only a keyboard input reflecting a key valuecorresponding to the push input is output, a mouse mode in which a pushinput relative to at least some of the plurality of buttons is ignoredand a mouse input indicating a movement distance and a movementdirection of a pointer is output by means of a variation of the touchcoordinate value, or a digitizer mode in which a push input relative toat least some of the plurality of buttons is output and a digitizerinput indicating a position of the pointer is output by means of thetouch coordinate value.

According to another aspect of the present invention, there may beprovided an electronic device having a multi-functional human interfacewith a keyboard layout, the electronic device comprising: a plurality ofbuttons arranged according to the keyboard layout and each having akeycap configured to receive a vertical push input from a user; a buttonbody combined with a lower portion of the keycap and configured to bemoved upward or downward according to the push input; and an electrodeinterposed between the keycap and the button body and configured toreceive a touch input from the user by means of a first block groupcomposed of blocks that are electrically connected in a first direction,which is any one of a length direction and a width direction of thekeyboard layout, and a second block group composed of blocks that areelectrically connected in a second direction different from the firstdirection, which is the other one of the length direction and the widthdirection of the keyboard layout; a plurality of switches arranged inlower portions of the plurality of buttons according to the keyboardlayout and each configured to acquire a key input when the button bodyis moved downward; an electric connection member configured toelectrically connect the first block group among buttons arranged in thefirst direction to form a drive line, which applies a drive signal forinducing capacitance in the electrode, and electrically connect thesecond block group among buttons arranged in the second direction toform a scan line, which receives a scan signal for detecting a changecaused by the touch input in the capacitance induced in the electrode bythe drive signal, in order to electrically connect the electrode amongthe buttons; and a controller configured to acquire a key valueallocated to a button corresponding to a switch that acquires the keyinput and acquire a touch coordinate value calculated using the changein the capacitance of the electrode corresponding to the touch input,wherein the controller operates in a keyboard mode in which the touchinput is output and only a keyboard input reflecting a key valuecorresponding to the push input is output, and a touch mode in which apush input relative to at least some of the plurality of buttons isignored and a pointer control signal reflecting the touch coordinatevalue is output, and wherein the controller calculates a touchcoordinate value corresponding to the touch input on the basis of thescan signal when operating in the touch mode, acquires a relativecoordinate value from the touch coordinate value when the touch mode isa mouse mode, and acquires an absolute coordinate value from the touchcoordinate value when the touch mode is a digitizer mode.

According to still another aspect of the present invention, there may beprovided a control method of an electronic device having amulti-functional human interface with a keyboard layout, wherein theelectronic device includes: a plurality of buttons arranged according tothe keyboard layout and each having a keycap configured to receive avertical push input from a user; a button body combined with a lowerportion of the keycap and configured to be moved upward or downwardaccording to the push input; and an electrode interposed between thekeycap and the button body and configured to receive a touch input fromthe user by means of a first block group composed of blocks that areelectrically connected in a first direction, which is any one of alength direction and a width direction of the keyboard layout, and asecond block group composed of blocks that are electrically connected ina second direction different from the first direction, which is theother one of the length direction and the width direction of thekeyboard layout; a plurality of switches arranged in lower portions ofthe plurality of buttons according to the keyboard layout and eachconfigured to acquire a key input when the button body is moveddownward; an electric connection member configured to electricallyconnect the first block group among buttons arranged in the firstdirection to form a drive line, which applies a drive signal forinducing capacitance in the electrode, and electrically connect thesecond block group among buttons arranged in the second direction toform a scan line, which receives a scan signal for detecting a changecaused by the touch input in the capacitance induced in the electrode bythe drive signal, in order to electrically connect the electrode amongthe buttons; and a controller configured to acquire a key valueallocated to a button corresponding to a switch that acquires the keyinput and acquire a touch coordinate value calculated using the changein the capacitance of the electrode corresponding to the touch input,the control method comprising: entering a keyboard mode; ignoring atouch input and outputting only a keyboard input reflecting a key valuecorresponding to a push input when operating in the keyboard mode;entering a mouse mode; ignoring a push input relative to at least someof the plurality of buttons and outputting a mouse input indicating amovement distance and a movement direction of a pointer by means of avariation of a touch coordinate value when operating in the mouse mode;entering a digitizer mode; and ignoring a push input relative to atleast some of the plurality of buttons and outputting a digitizer inputindicating a position of a pointer by means of the touch coordinatevalue.

According to yet another aspect of the present invention, there may beprovided a control method of an electronic device having amulti-functional human interface with a keyboard layout, wherein theelectronic device includes: a plurality of buttons arranged according tothe keyboard layout and each having a keycap configured to receive avertical push input from a user; a button body combined with a lowerportion of the keycap and configured to be moved upward or downwardaccording to the push input; and an electrode interposed between thekeycap and the button body and configured to receive a touch input fromthe user by means of a first block group composed of blocks that areelectrically connected in a first direction, which is any one of alength direction and a width direction of the keyboard layout, and asecond block group composed of blocks that are electrically connected ina second direction different from the first direction, which is theother one of the length direction and the width direction of thekeyboard layout; a plurality of switches arranged in lower portions ofthe plurality of buttons according to the keyboard layout and eachconfigured to acquire a key input when the button body is moveddownward; an electric connection member configured to electricallyconnect the first block group among buttons arranged in the firstdirection to form a drive line, which applies a drive signal forinducing capacitance in the electrode, and electrically connect thesecond block group among buttons arranged in the second direction toform a scan line, which receives a scan signal for detecting a changecaused by the touch input in the capacitance induced in the electrode bythe drive signal, in order to electrically connect the electrode amongthe buttons; and a controller configured to acquire a key valueallocated to a button corresponding to a switch that acquires the keyinput and acquire a touch coordinate value calculated using the changein the capacitance of the electrode corresponding to the touch input,the control method comprising: entering any one of a keyboard mode inwhich a touch input is ignored and only a keyboard input reflecting akey value corresponding to a push input is output, and a touch mode inwhich a push input relative to at least some of the plurality of buttonsis ignored and a pointer control signal reflecting a touch coordinatevalue is output; calculating a touch coordinate value corresponding to atouch input on the basis of a scan signal when operating in the touchmode; acquiring a relative coordinate value from the touch coordinatevalue when the touch mode is a mouse mode; acquiring an absolutecoordinate value from the touch coordinate value when the touch mode isa digitizer mode; and outputting a pointer position control signal onthe basis of any one of the relative coordinate value and the absolutecoordinate value.

According to yet another aspect of the present invention, there may beprovided an electronic device having a multi-functional human interfacewith a keyboard layout, the electronic device including a plurality ofbuttons arranged according to the keyboard layout and each having akeycap configured to receive a vertical push input from a user; a buttonbody combined with a lower portion of the keycap and configured to bemoved downward according to the push input; and an electrode interposedbetween the keycap and the button body and configured to receive a touchinput from the user by means of a first block group composed of blocksthat are electrically connected in a first direction, which is any oneof a length direction and a width direction of the keyboard layout, anda second block group composed of blocks that are electrically connectedin a second direction different from the first direction, which is theother one of the length direction and the width direction of thekeyboard layout; a plurality of switches arranged in lower portions ofthe plurality of buttons according to the keyboard layout and eachconfigured to acquire a key input when the button body is moveddownward; an electric connection member configured to electricallyconnect the first block group among buttons arranged in the firstdirection to form a drive line, which applies a drive signal forinducing capacitance in the electrode, and electrically connect thesecond block group among buttons arranged in the second direction toform a scan line, which receives a scan signal for detecting a changecaused by the touch input in the capacitance induced in the electrode bythe drive signal, in order to electrically connect the electrode amongthe buttons; and a controller configured to acquire a key valueallocated to a button corresponding to a switch that acquires the keyinput and acquire a touch coordinate value calculated using the changein the capacitance of the electrode corresponding to the touch input,wherein the controller may operate in any one of the keyboard mode inwhich a touch input is ignored and only a keyboard input reflecting akey value corresponding to a push input is output, and a touch mode inwhich a first touch signal for controlling a position of a pointer isoutput according to a touch coordinate value, and may output a secondtouch signal indicating that an attribute value of an adjustment targetattribute is adjusted when a key input relative to a button having a keyvalue to which the adjustment target attribute is allocated is acquiredwhile operating in the touch mode.

According to yet another aspect of the present invention, there may beprovided an electronic device having a multi-functional human interfacewith a keyboard layout, the electronic device including a plurality ofbuttons arranged according to the keyboard layout and each having akeycap configured to receive a vertical push input from a user; a buttonbody combined with a lower portion of the keycap and configured to bemoved downward according to the push input; and an electrode interposedbetween the keycap and the button body and configured to receive a touchinput from the user by means of a first block group composed of blocksthat are electrically connected in a first direction, which is any oneof a length direction and a width direction of the keyboard layout, anda second block group composed of blocks that are electrically connectedin a second direction different from the first direction, which is theother one of the length direction and the width direction of thekeyboard layout; a plurality of switches arranged in lower portions ofthe plurality of buttons according to the keyboard layout and eachconfigured to acquire a key input when the button body is moveddownward; an electric connection member configured to electricallyconnect the first block group among buttons arranged in the firstdirection to form a drive line, which applies a drive signal forinducing capacitance in the electrode, and electrically connect thesecond block group among buttons arranged in the second direction toform a scan line, which receives a scan signal for detecting a changecaused by the touch input in the capacitance induced in the electrode bythe drive signal, in order to electrically connect the electrode amongthe buttons; and a controller configured to acquire a key valueallocated to a button corresponding to a switch that acquires the keyinput and acquire a touch coordinate value calculated using the changein the capacitance of the electrode corresponding to the touch input,wherein the controller may determine the keyboard mode or the touch modewhen a key input is acquired, output a character value corresponding tothe key input when the keyboard mode is determined, and operate in anattribute adjustment mode in which the touch input is used to adjust aspecific attribute value when the touch mode is determined.

According to yet another aspect of the present invention, there may beprovided a control method of an electronic device having amulti-functional human interface with a keyboard layout, wherein theelectronic device includes a plurality of buttons arranged according tothe keyboard layout and each having a keycap configured to receive avertical push input from a user; a button body combined with a lowerportion of the keycap and configured to be moved downward according tothe push input; and an electrode interposed between the keycap and thebutton body and configured to receive a touch input from the user bymeans of a first block group composed of blocks that are electricallyconnected in a first direction, which is any one of a length directionand a width direction of the keyboard layout, and a second block groupcomposed of blocks that are electrically connected in a second directiondifferent from the first direction, which is the other one of the lengthdirection and the width direction of the keyboard layout; a plurality ofswitches arranged in lower portions of the plurality of buttonsaccording to the keyboard layout and each configured to acquire a keyinput when the button body is moved downward; an electric connectionmember configured to electrically connect the first block group amongbuttons arranged in the first direction to form a drive line, whichapplies a drive signal for inducing capacitance in the electrode, andelectrically connect the second block group among buttons arranged inthe second direction to form a scan line, which receives a scan signalfor detecting a change caused by the touch input in the capacitanceinduced in the electrode by the drive signal, in order to electricallyconnect the electrode among the buttons; and a controller configured toacquire a key value allocated to a button corresponding to a switch thatacquires the key input and acquire a touch coordinate value calculatedusing the change in the capacitance of the electrode corresponding tothe touch input, the control method including entering the keyboardmode; ignoring the touch input, and outputting only a keyboard inputreflecting a key value corresponding to the push input when operating inthe keyboard mode; entering the touch mode; outputting a first touchsignal for controlling a position of a pointer according to the touchcoordinate value when operating in the touch mode; receiving a key inputrelative to a button having a key value to which a target controlattribute is allocated while operating in the touch mode; and outputtinga second touch signal for instructing that an attribute value of theadjustment target attribute be adjusted according to the touchcoordinate value.

According to yet another aspect of the present invention, there may beprovided a control method of an electronic device having amulti-functional human interface with a keyboard layout includes aplurality of buttons arranged according to the keyboard layout and eachhaving a keycap configured to receive a vertical push input from a user;a button body combined with a lower portion of the keycap and configuredto be moved downward according to the push input; and an electrodeinterposed between the keycap and the button body and configured toreceive a touch input from the user by means of a first block groupcomposed of blocks that are electrically connected in a first direction,which is any one of a length direction and a width direction of thekeyboard layout, and a second block group composed of blocks that areelectrically connected in a second direction different from the firstdirection, which is the other one of the length direction and the widthdirection of the keyboard layout; a plurality of switches arranged inlower portions of the plurality of buttons according to the keyboardlayout and each configured to acquire a key input when the button bodyis moved downward; and an electric connection member configured toelectrically connect the first block group among buttons arranged in thefirst direction to form a drive line, which applies a drive signal forinducing capacitance in the electrode, and electrically connect thesecond block group among buttons arranged in the second direction toform a scan line, which receives a scan signal for detecting a changecaused by the touch input in the capacitance induced in the electrode bythe drive signal, in order to electrically connect the electrode amongthe buttons, the control method comprising: determining the keyboardmode or the touch mode when a key input is acquired, outputting acharacter value corresponding to the key input when the keyboard mode isdetermined, and operating in the attribute adjustment mode in which thetouch input is used to adjust a specific attribute value when the touchmode is determined.

According to yet another aspect of the present invention, there may beprovided an electronic device that has a multi-functional humaninterface with a keyboard layout and is used as an input interface for aplurality of output devices in a multi-device environment, theelectronic device including a plurality of buttons arranged according tothe keyboard layout and each having a keycap configured to receive avertical push input from a user; a button body combined with a lowerportion of the keycap and configured to be moved downward according tothe push input; and an electrode interposed between the keycap and thebutton body and configured to receive a gesture input including a touchoperation or a hovering operation from the user by means of a firstblock group composed of blocks that are electrically connected in afirst direction, which is any one of a length direction and a widthdirection of the keyboard layout, and a second block group composed ofblocks that are electrically connected in a second direction differentfrom the first direction, which is the other one of the length directionand the width direction of the keyboard layout; a plurality of switchesarranged in lower portions of the plurality of buttons according to thekeyboard layout and each configured to acquire a key input when thebutton body is moved downward; an electric connection member configuredto electrically connect the first block group among buttons arranged inthe first direction to form a drive line, which applies a drive signalfor inducing capacitance in the electrode, and electrically connect thesecond block group among buttons arranged in the second direction toform a scan line, which receives a scan signal for detecting a changecaused by the gesture input in the capacitance induced in the electrodeby the drive signal, in order to electrically connect the electrodeamong the buttons; and a controller configured to acquire a key valueallocated to a button corresponding to a switch that acquires the keyinput, determine that the gesture input is a touch input when the amountof change in the capacitance is greater than a touch threshold,calculate a touch coordinate value from the change in the capacitancecaused by the touch input, output a first signal indicating that apointer moved on a control target screen, which is one of the pluralityof output devices, on the basis of the calculated touch coordinatevalue, determine that the gesture input is a hovering input when theamount of change in capacitance is less than the touch threshold andgreater than a hovering threshold, calculate a hovering coordinate valuefrom the change in the capacitance according to the hovering input, andoutput a second signal indicating that a virtual point moved in avirtual space, an actual space, or an augmented space on the basis ofthe calculated hovering coordinate value.

According to yet another aspect of the present invention, there may beprovided a control method of an electronic device that has amulti-functional human interface with a keyboard layout and is used asan input interface for a plurality of output devices in a multi-deviceenvironment, wherein the electronic device includes a plurality ofbuttons arranged according to the keyboard layout and each having akeycap configured to receive a vertical push input from a user; a buttonbody combined with a lower portion of the keycap and configured to bemoved downward according to the push input; and an electrode interposedbetween the keycap and the button body and configured to receive a touchinput from the user by means of a first block group composed of blocksthat are electrically connected in a first direction, which is any oneof a length direction and a width direction of the keyboard layout, anda second block group composed of blocks that are electrically connectedin a second direction different from the first direction, which is theother one of the length direction and the width direction of thekeyboard layout; a plurality of switches arranged in lower portions ofthe plurality of buttons according to the keyboard layout and eachconfigured to acquire a key input when the button body is moveddownward; and an electric connection member configured to electricallyconnect the first block group among buttons arranged in the firstdirection to form a drive line, which applies a drive signal forinducing capacitance in the electrode, and electrically connect thesecond block group among buttons arranged in the second direction toform a scan line, which receives a scan signal for detecting a changecaused by a gesture input in the capacitance induced in the electrode bythe drive signal, in order to electrically connect the electrode amongthe buttons, the control method comprising: acquiring a key valueallocated to a button corresponding to a switch that acquires a keyinput and outputting a keyboard input reflecting the key value;determining that the gesture input is a touch input when the amount ofchange in the capacitance is greater than a touch threshold; calculatinga touch coordinate value from the change in the capacitance caused bythe touch input; outputting a first signal indicating that a pointermoved on a control target screen, which is one of the plurality ofoutput devices, on the basis of the calculated touch coordinate value;determining that the gesture input is a hovering input when the amountof change in capacitance is less than the touch threshold and greaterthan a hovering threshold; calculating a hovering coordinate value fromthe change in the capacitance according to the hovering input; andoutputting a second signal indicating that a virtual point moved in avirtual space, an actual space, or an augmented space on the basis ofthe calculated hovering input.

Technical solutions intended to be solved by the invention are notlimited to the aforementioned solutions, and other solutions that arenot described herein will be clearly understood by those skilled in theart from the following description and the accompanying drawings.

Advantageous Effects

The text input device and the pointing device, which are providedseparately, are integrated in one human interface device so as to reduceunit price and size of a product and eliminate unnecessary useroperation, thereby improving work efficiency.

According to the present invention, it is possible to utilize a singlepointing-device-integrated text device as a digitizer interface as wellas a keyboard interface and a mouse interface.

With the pointing-device-integrated text device according to the presentinvention, it is also possible to select a corresponding attribute bymeans of a pointer when an attribute value such as audio volume isadjusted and to easily adjust a desired attribute value by simply usinga push input and a touch input without the inconvenience of using thepointer again to adjust a position of an indicator indicating theattribute value in the selected attribute.

According to the present invention, it is possible to use a singlepointing-device-integrated text device as an input interface for aplurality of devices in a multi-device environment.

Advantageous effects of the invention are not limited to theaforementioned effects, and other advantageous effects that are notdescribed herein will be clearly understood by those skilled in the artfrom the following description and the accompanying drawings.

DESCRIPTION OF DRAWINGS

FIG. 1 illustrates an exemplary embodiment of a text input deviceintegrated with a pointing device.

FIG. 2 is flowchart illustrating an exemplary embodiment of an operationsequence according to mode switching between a pointing device and atext device.

FIG. 3 illustrates exemplary embodiments of configurations of text inputdevices and pointing devices.

FIG. 4 illustrates exemplary embodiments of a mode switching unitintegrated with a pointer execution instruction unit.

FIG. 5 illustrates an exemplary embodiment of a pointer locationinformation input region.

FIG. 6 illustrates an exemplary embodiment of a mode switching unitintegrated with a pointer execution instruction unit.

FIG. 7 illustrates an exemplary embodiment of a utilization of a humaninterface device cover adopting a bottom-located pointer locationinformation input device.

FIG. 8 illustrates an exemplary embodiment of a human interface deviceapplied to a portable notebook.

FIG. 9 illustrates an exemplary embodiment adopting a bottom-locatedpointer location information input device and a bottom-located pointerexecution instruction unit.

FIG. 10 is an exploded perspective view illustrating a multi-functionalinput button.

FIG. 11 illustrates an exemplary embodiment of an electrode of amulti-functional input button.

FIG. 12 illustrates an exemplary embodiment of an arrangement ofmulti-functional input buttons.

FIG. 13 illustrates an exemplary embodiment of an arrangement ofelectrodes of multi-functional input buttons having different patterns.

FIG. 14 illustrates exemplary embodiments of an electrical connectionmember of a multi-functional input button.

FIG. 15 illustrates an exemplary embodiment of a switch of amulti-functional input button for inputting characters.

FIG. 16 illustrates an exemplary embodiment of a human interface devicehaving a multi-functional input button.

FIG. 17 illustrates an exemplary embodiment of an electrode key cap.

FIG. 18 to FIG. 22 illustrate an exemplary embodiment of electrodepatterns of a plurality of multi-functional input buttons.

FIG. 23 is a flowchart illustrating a method for switching between atext input mode and a pointer location information input mode.

FIG. 24 is a flowchart illustrating a method for switching to apermanent touch mode.

FIG. 25 illustrates a multi-functional input button module having aplurality of multi-functional input buttons provided in the shape of aplate.

FIG. 26 illustrates an example of a detailed structure of the electrodeunit 1020.

FIG. 27 illustrates an example of an adhesion part for a conductiveadhesive.

FIG. 28 illustrates an exemplary embodiment of a multi-functional inputbutton.

FIG. 29 illustrates an exemplary embodiment of a wireless electricalconnection member.

FIG. 30 is an example of a block diagram of a pointing-device-integratedtext input device.

FIG. 31 is an example in which the pointing-device-integrated text inputdevice of FIG. 30 performs signal processing on a text input.

FIG. 32 is an example in which the pointing-device-integrated text inputdevice of FIG. 30 performs signal processing on a mouse input.

FIGS. 33 and 34 are an example of an operation of a pointercorresponding to the mouse input of FIG. 32 .

FIGS. 35 and 36 are another example of an operation of the pointercorresponding to the mouse input of FIG. 32 .

FIG. 37 is an example of digitizer input signal processing of thepointing-device-integrated text input device of FIG. 30 .

FIG. 38 is an example of an operation of a pointer corresponding to adigitizer input of FIG. 37 .

FIG. 39 is another example of an operation of the pointer correspondingto the digitizer input of FIG. 37.

FIG. 40 is an example of mode switching of thepointing-device-integrated text input device of FIG. 30 .

FIG. 41 is an example in which the pointing-device-integrated text inputdevice of FIG. 30 sets a touch region according to a digitizer mode.

FIGS. 42 and 43 are an example of a relationship between a touch regioncorresponding to the digitizer mode of FIG. 41 and a touch regioncorresponding to a mouse mode.

FIGS. 44 and 45 are another example of setting a touch region accordingto the digitizer mode of the pointing-device-integrated text inputdevice of FIG. 30 .

FIG. 46 is an example in which the outside of a touchable region is setas a touch region during the touch region setting of FIGS. 44 and 45 .

FIG. 47 is an example of resetting a touch region according to thedigitizer mode of FIG. 46 .

FIG. 48 is another example of resetting a touch region according to thedigitizer mode of FIG. 46 .

FIG. 49 is a flowchart showing an example of a mode switching method ofthe pointing-device-integrated text input device of FIG. 30 .

FIG. 50 is a flowchart showing a method of thepointing-device-integrated text input device of FIG. 30 processing atouch input in the mouse mode and the digitizer mode.

FIG. 51 is a flowchart showing an example of a method of thepointing-device-integrated text input device of FIG. 30 setting a touchregion in the digitizer mode.

FIG. 52 is a flowchart showing another example of a method of thepointing-device-integrated text input device of FIG. 30 setting a touchregion in the digitizer mode.

FIG. 53 is a flowchart showing a method of thepointing-device-integrated text input device of FIG. 30 resetting atouch region in the digitizer mode.

FIG. 54 is a view showing some examples of adjustment target attributes.

FIG. 55 is a diagram showing a matching relationship between anadjustment target attribute and a button of thepointing-device-integrated text input device.

FIGS. 56 and 57 are diagrams showing an example in which thepointing-device-integrated text input device adjusts an adjustmenttarget attribute.

FIG. 58 is a diagram showing another example in which thepointing-device-integrated text input device adjusts an adjustmenttarget attribute.

FIG. 59 is a diagram showing still another example in which thepointing-device-integrated text input device adjusts an adjustmenttarget attribute.

FIG. 60 is a diagram showing a first example in which thepointing-device-integrated text input device processes a touch input foradjusting an adjustment target attribute.

FIG. 61 is a diagram showing a second example in which thepointing-device-integrated text input device processes a touch input foradjusting an adjustment target attribute.

FIG. 62 is a diagram showing a third example in which thepointing-device-integrated text input device processes a touch input foradjusting an adjustment target attribute.

FIG. 63 is a diagram showing a fourth example in which thepointing-device-integrated text input device processes a touch input foradjusting an adjustment target attribute.

FIG. 64 is a diagram showing a fifth example in which thepointing-device-integrated text input device processes a touch input foradjusting an adjustment target attribute.

FIG. 65 is a diagram showing a sixth example in which thepointing-device-integrated text input device processes a touch input foradjusting an adjustment target attribute.

FIG. 66 is a diagram showing a seventh example in which thepointing-device-integrated text input device processes a touch input foradjusting an adjustment target attribute.

FIG. 67 is a flowchart showing an example in which thepointing-device-integrated text input device adjusts an adjustmenttarget attribute.

FIG. 68 is a flowchart showing another example in which thepointing-device-integrated text input device adjusts an adjustmenttarget attribute.

FIG. 69 is a flowchart showing still another example in which thepointing-device-integrated text input device adjusts an adjustmenttarget attribute.

FIG. 70 is a flowchart showing still another example in which thepointing-device-integrated text input device adjusts an adjustmenttarget attribute.

FIG. 71 is a flowchart showing still another example in which thepointing-device-integrated text input device adjusts an adjustmenttarget attribute.

FIG. 72 is an example of a hovering input of thepointing-device-integrated text input device.

FIG. 73 is an example of a multi-device environment using thepointing-device-integrated text input device of FIG. 30 .

FIG. 74 is a diagram showing an example of selecting a control targetdevice by using a hovering input in the multi-device environment of FIG.73 .

FIG. 75 is a diagram showing another example of selecting a controltarget device by using a hovering input in the multi-device environmentof FIG. 73 .

FIG. 76 is a diagram showing still another example of selecting acontrol target device by using a hovering input in the multi-deviceenvironment of FIG. 73 .

FIG. 77 is a flowchart showing an example in which thepointing-device-integrated text input device controls multiple devices.

BEST MODE

Embodiments described in this specification are made to clearly explainthe spirit of the invention to those skilled in the art, and do notintend to limit the present invention. It should be interpreted that thepresent invention may include substitutions or modifications withoutdeparting from the spirit of the present invention.

Terms used herein have been selected as general terms which are widelyused at present in consideration of the functions of the presentinvention, but may be altered according to the intent of an operator ofordinary skill in the art, conventional practice, or the introduction ofnew technology. However, when a specified term is defined and used in anarbitrary sense, the meaning of the term will be described separately.Accordingly, the terms used herein are not defined as simple names ofthe components, but are defined on the basis of the actual meaning ofthe terms and the whole context throughout the present specification.

The accompanying drawings are for facilitating the explanation of thepresent invention, and a shape in the drawings may be exaggerated forthe purpose of convenience of explanation, and thus the presentinvention is not limited to the drawings.

In addition, details of generally known functions and structures whichobscure the subject matter of the present invention will be omitted.

According to an aspect of the present invention, there may be providedan electronic device having a multi-functional human interface with akeyboard layout, the electronic device comprising: a plurality ofbuttons arranged according to the keyboard layout and each having akeycap configured to receive a vertical push input from a user; a buttonbody combined with a lower portion of the keycap and configured to bemoved upward or downward according to the push input; and an electrodeinterposed between the keycap and the button body and configured toreceive a touch input from the user by means of a first block groupcomposed of blocks that are electrically connected in a first direction,which is any one of a length direction and a width direction of thekeyboard layout, and a second block group composed of blocks that areelectrically connected in a second direction different from the firstdirection, which is the other one of the length direction and the widthdirection of the keyboard layout; a plurality of switches arranged inlower portions of the plurality of buttons according to the keyboardlayout and each configured to acquire a key input when the button bodyis moved downward; an electric connection member configured toelectrically connect the first block group among buttons arranged in thefirst direction to form a drive line, which applies a drive signal forinducing capacitance in the electrode, and electrically connect thesecond block group among buttons arranged in the second direction toform a scan line, which receives a scan signal for detecting a changecaused by the touch input in the capacitance induced in the electrode bythe drive signal, in order to electrically connect the electrode amongthe buttons; and a controller configured to acquire a key valueallocated to a button corresponding to a switch that acquires the keyinput and acquire a touch coordinate value calculated using the changein the capacitance of the electrode corresponding to the touch input,wherein the controller operates in a keyboard mode in which the touchinput is ignored and only a keyboard input reflecting a key valuecorresponding to the push input is output, a mouse mode in which a pushinput relative to at least some of the plurality of buttons is ignoredand a mouse input indicating a movement distance and a movementdirection of a pointer is output by means of a variation of the touchcoordinate value, or a digitizer mode in which a push input relative toat least some of the plurality of buttons is output and a digitizerinput indicating a position of the pointer is output by means of thetouch coordinate value.

The controller may calculate the variation of the touch coordinate valuein the mouse mode through a difference operation between a touchcoordinate value during a current scan period and a touch coordinatevalue during a previous scan period, and output the digitizer input fromthe touch coordinate value in the digitizer mode in consideration of amatching relationship between a screen region of a display outputtingthe pointer and the touch coordinate value.

The controller may set the matching relationship so that the position ofthe pointer on the screen region corresponds to a touch coordinate valueof a touch input that is first applied after the digitizer mode isentered.

The controller may calculate the variation of the touch coordinate valuein the mouse mode through a difference operation between a touchcoordinate value during a current scan period and a touch coordinatevalue during a previous scan period, and acquire the digitizer input inthe digitizer mode through the current touch coordinate value and atouch coordinate value of a touch input that is first applied after thedigitizer mode is entered.

The controller may determine whether the mouse mode is a left-hand modeor a right-hand mode when the mouse mode is entered, activate onlyelectrodes of buttons located at a left side of an entire touch sensingregion when the mouse mode is the left-hand mode, activate onlyelectrodes of buttons located at a right side of the entire touchsensing region when the mouse mode is the right-hand mode, and activateall of the electrodes of the buttons located within the entire touchsensing region when the digitizer mode is entered.

The controller may set a touch region matched to a screen region inwhich the pointer is displayed so that a touch coordinate value of atouch input that is first applied after the digitizer mode is entered ismatched to a position of the pointer on the screen region.

When a touch input is generated in a region outside the touch regionthat is within the entire touch sensing region, the controller may resetthe touch region according to the touch input applied to the outsideregion.

The controller may differently set a touch region matched to a screenregion in which the pointer is displayed according to a touch input thatis first applied after the digitizer mode is entered.

According to another aspect of the present invention, there may beprovided an electronic device having a multi-functional human interfacewith a keyboard layout, the electronic device comprising: a plurality ofbuttons arranged according to the keyboard layout and each having akeycap configured to receive a vertical push input from a user; a buttonbody combined with a lower portion of the keycap and configured to bemoved upward or downward according to the push input; and an electrodeinterposed between the keycap and the button body and configured toreceive a touch input from the user by means of a first block groupcomposed of blocks that are electrically connected in a first direction,which is any one of a length direction and a width direction of thekeyboard layout, and a second block group composed of blocks that areelectrically connected in a second direction different from the firstdirection, which is the other one of the length direction and the widthdirection of the keyboard layout; a plurality of switches arranged inlower portions of the plurality of buttons according to the keyboardlayout and each configured to acquire a key input when the button bodyis moved downward; an electric connection member configured toelectrically connect the first block group among buttons arranged in thefirst direction to form a drive line, which applies a drive signal forinducing capacitance in the electrode, and electrically connect thesecond block group among buttons arranged in the second direction toform a scan line, which receives a scan signal for detecting a changecaused by the touch input in the capacitance induced in the electrode bythe drive signal, in order to electrically connect the electrode amongthe buttons; and a controller configured to acquire a key valueallocated to a button corresponding to a switch that acquires the keyinput and acquire a touch coordinate value calculated using the changein the capacitance of the electrode corresponding to the touch input,wherein the controller operates in a keyboard mode in which the touchinput is output and only a keyboard input reflecting a key valuecorresponding to the push input is output, and a touch mode in which apush input relative to at least some of the plurality of buttons isignored and a pointer control signal reflecting the touch coordinatevalue is output, and wherein the controller calculates a touchcoordinate value corresponding to the touch input on the basis of thescan signal when operating in the touch mode, acquires a relativecoordinate value from the touch coordinate value when the touch mode isa mouse mode, and acquires an absolute coordinate value from the touchcoordinate value when the touch mode is a digitizer mode.

The relative coordinate value may be calculated through a differenceoperation between a touch coordinate value during a current scan periodand a touch coordinate value during a previous scan period, and theabsolute coordinate value may be calculated using the touch coordinatevalue in consideration of a matching relationship between a touch regionand a screen region in which a pointer is displayed.

The controller may set the matching relationship on the basis of a touchcoordinate value of a touch input that is first applied after thedigitizer mode is entered.

The relative coordinate value may be calculated through a differenceoperation between a touch coordinate value during a current scan periodand a touch coordinate value during a previous scan period, and theabsolute coordinate value may be calculated through a differenceoperation between the touch coordinate value during the current scanperiod and a touch coordinate value that is first applied after thedigitizer mode is entered.

According to still another aspect of the present invention, there may beprovided a control method of an electronic device having amulti-functional human interface with a keyboard layout, wherein theelectronic device includes: a plurality of buttons arranged according tothe keyboard layout and each having a keycap configured to receive avertical push input from a user; a button body combined with a lowerportion of the keycap and configured to be moved upward or downwardaccording to the push input; and an electrode interposed between thekeycap and the button body and configured to receive a touch input fromthe user by means of a first block group composed of blocks that areelectrically connected in a first direction, which is any one of alength direction and a width direction of the keyboard layout, and asecond block group composed of blocks that are electrically connected ina second direction different from the first direction, which is theother one of the length direction and the width direction of thekeyboard layout; a plurality of switches arranged in lower portions ofthe plurality of buttons according to the keyboard layout and eachconfigured to acquire a key input when the button body is moveddownward; an electric connection member configured to electricallyconnect the first block group among buttons arranged in the firstdirection to form a drive line, which applies a drive signal forinducing capacitance in the electrode, and electrically connect thesecond block group among buttons arranged in the second direction toform a scan line, which receives a scan signal for detecting a changecaused by the touch input in the capacitance induced in the electrode bythe drive signal, in order to electrically connect the electrode amongthe buttons; and a controller configured to acquire a key valueallocated to a button corresponding to a switch that acquires the keyinput and acquire a touch coordinate value calculated using the changein the capacitance of the electrode corresponding to the touch input,the control method comprising: entering a keyboard mode; ignoring atouch input and outputting only a keyboard input reflecting a key valuecorresponding to a push input when operating in the keyboard mode;entering a mouse mode; ignoring a push input relative to at least someof the plurality of buttons and outputting a mouse input indicating amovement distance and a movement direction of a pointer by means of avariation of a touch coordinate value when operating in the mouse mode;entering a digitizer mode; and ignoring a push input relative to atleast some of the plurality of buttons and outputting a digitizer inputindicating a position of a pointer by means of the touch coordinatevalue.

The outputting of a mouse input may comprise calculating the variationof the touch coordinate value through a difference operation between atouch coordinate value during a current scan period and a touchcoordinate value during a previous scan period, and the outputting of adigitizer input may comprise acquiring the digitizer input from thetouch coordinate value in consideration of a matching relationshipbetween a screen region of a display outputting the pointer and thetouch coordinate value.

The control method may further comprise: setting the matchingrelationship so that the position of the pointer on the screen regioncorresponds to a touch coordinate value of a touch input that is firstapplied after the digitizer mode is entered.

The outputting of a mouse input may comprise calculating the variationof the touch coordinate value through a difference operation between atouch coordinate value during a current scan period and a touchcoordinate value during a previous scan period; and the outputting of adigitizer input may comprise acquiring the digitizer input through adifference operation between the current touch coordinate value and atouch coordinate value of a touch input that is first applied after thedigitizer mode is entered.

The control method may further comprise: determining whether the mousemode is a left-hand mode or a right-hand mode when the mouse mode isentered; activating only electrodes of buttons located at a left side ofan entire touch sensing region when the mouse mode is the left-handmode; activating only electrodes of buttons located at a right side ofthe entire touch sensing region when the mouse mode is the right-handmode; and activating all of the electrodes of the buttons located withinthe entire touch sensing region when the digitizer mode is entered.

The control method may further comprise: setting a touch region matchedto a screen region in which the pointer is displayed so that a touchcoordinate value of a touch input that is first applied after thedigitizer mode is entered is matched to a position of the pointer on thescreen region.

The control method may further comprise: acquiring a touch input to aregion outside the touch region within an entire touch sensing regionwhile operating in the digitizer mode; and resetting the touch regionaccording to a touch input applied to the outside region.

The control method may further comprise: setting a different touchregion matched to a screen region in which the pointer is displayedaccording to a touch input that is first applied after the digitizermode is entered.

According to yet another aspect of the present invention, there may beprovided a control method of an electronic device having amulti-functional human interface with a keyboard layout, wherein theelectronic device includes: a plurality of buttons arranged according tothe keyboard layout and each having a keycap configured to receive avertical push input from a user; a button body combined with a lowerportion of the keycap and configured to be moved upward or downwardaccording to the push input; and an electrode interposed between thekeycap and the button body and configured to receive a touch input fromthe user by means of a first block group composed of blocks that areelectrically connected in a first direction, which is any one of alength direction and a width direction of the keyboard layout, and asecond block group composed of blocks that are electrically connected ina second direction different from the first direction, which is theother one of the length direction and the width direction of thekeyboard layout; a plurality of switches arranged in lower portions ofthe plurality of buttons according to the keyboard layout and eachconfigured to acquire a key input when the button body is moveddownward; an electric connection member configured to electricallyconnect the first block group among buttons arranged in the firstdirection to form a drive line, which applies a drive signal forinducing capacitance in the electrode, and electrically connect thesecond block group among buttons arranged in the second direction toform a scan line, which receives a scan signal for detecting a changecaused by the touch input in the capacitance induced in the electrode bythe drive signal, in order to electrically connect the electrode amongthe buttons; and a controller configured to acquire a key valueallocated to a button corresponding to a switch that acquires the keyinput and acquire a touch coordinate value calculated using the changein the capacitance of the electrode corresponding to the touch input,the control method comprising: entering any one of a keyboard mode inwhich a touch input is ignored and only a keyboard input reflecting akey value corresponding to a push input is output, and a touch mode inwhich a push input relative to at least some of the plurality of buttonsis ignored and a pointer control signal reflecting a touch coordinatevalue is output; calculating a touch coordinate value corresponding to atouch input on the basis of a scan signal when operating in the touchmode; acquiring a relative coordinate value from the touch coordinatevalue when the touch mode is a mouse mode; acquiring an absolutecoordinate value from the touch coordinate value when the touch mode isa digitizer mode; and outputting a pointer position control signal onthe basis of any one of the relative coordinate value and the absolutecoordinate value.

The control method may further comprise: calculating the relativecoordinate value through a difference operation between a touchcoordinate value during a current scan period and a touch coordinatevalue during a previous scan period; and calculating the absolutecoordinate value through the touch coordinate value in consideration ofa matching relationship between a touch region and a screen region inwhich a pointer is displayed.

The control method may further comprise: setting the matchingrelationship on the basis of a touch coordinate value of a touch inputthat is first applied after the digitizer mode is entered.

The control method may further comprise: calculating the relativecoordinate value through a difference operation between a touchcoordinate value during a current scan period and a touch coordinatevalue during a previous scan period; and calculating the absolutecoordinate value through a difference operation between touch coordinatevalues of touch inputs that are first applied after the digitizer modeis entered.

According to yet another aspect of the present invention, there may beprovided an electronic device having a multi-functional human interfacewith a keyboard layout, the electronic device including a plurality ofbuttons arranged according to the keyboard layout and each having akeycap configured to receive a vertical push input from a user; a buttonbody combined with a lower portion of the keycap and configured to bemoved downward according to the push input; and an electrode interposedbetween the keycap and the button body and configured to receive a touchinput from the user by means of a first block group composed of blocksthat are electrically connected in a first direction, which is any oneof a length direction and a width direction of the keyboard layout, anda second block group composed of blocks that are electrically connectedin a second direction different from the first direction, which is theother one of the length direction and the width direction of thekeyboard layout; a plurality of switches arranged in lower portions ofthe plurality of buttons according to the keyboard layout and eachconfigured to acquire a key input when the button body is moveddownward; an electric connection member configured to electricallyconnect the first block group among buttons arranged in the firstdirection to form a drive line, which applies a drive signal forinducing capacitance in the electrode, and electrically connect thesecond block group among buttons arranged in the second direction toform a scan line, which receives a scan signal for detecting a changecaused by the touch input in the capacitance induced in the electrode bythe drive signal, in order to electrically connect the electrode amongthe buttons; and a controller configured to acquire a key valueallocated to a button corresponding to a switch that acquires the keyinput and acquire a touch coordinate value calculated using the changein the capacitance of the electrode corresponding to the touch input,wherein the controller may operate in any one of the keyboard mode inwhich a touch input is ignored and only a keyboard input reflecting akey value corresponding to a push input is output, and a touch mode inwhich a first touch signal for controlling a position of a pointer isoutput according to a touch coordinate value, and may output a secondtouch signal indicating that an attribute value of an adjustment targetattribute is adjusted when a key input relative to a button having a keyvalue to which the adjustment target attribute is allocated is acquiredwhile operating in the touch mode.

The controller may output a signal for instructing that the adjustmenttarget attribute be activated when the key for the button having the keyvalue to which the adjustment target attribute is allocated is acquiredwhile operating in the touch mode.

The activation of the adjustment target attribute may include displayinga graphic object for adjusting the adjustment target attribute.

The controller may generate the second touch signal on the basis of onlyone of a vertical value and a horizontal value of the touch coordinatevalue when the adjustment target attribute has a one-dimensional (1D)attribute value.

The controller may generate the second touch signal on the basis of avalue corresponding to a movement direction of an indicator on thegraphic object for adjusting the adjustment target attribute, which isone of the vertical value and the horizontal value of the touchcoordinate value.

The controller may generate the second touch signal on the basis of adifference operation between a touch coordinate value during a currentscan period and a touch coordinate value during a previous scan period.

The controller may set a touch region for adjusting the adjustmenttarget attribute corresponding to a range of an attribute value of theadjustment target attribute.

The controller may set the touch region such that a maximum value of theattribute value of the adjustment target attribute is matched to a topend or a rightmost side of the touch region and a minimum value of theattribute value is matched to a bottom end or a leftmost side of thetouch region.

The controller may generate the second touch signal such that the touchcoordinate value and a current attribute value of the adjustment targetattribute correspond to each other.

The controller may generate a matching relationship between theattribute value of the adjustment target attribute and a touchcoordinate value of a touch input that is first applied after a keyinput relative to the button having the key value to which theadjustment target attribute is allocated is acquired, and may generatethe second touch signal on the basis of the touch coordinate value andthe matching relationship.

The controller may generate the second touch signal through a differenceoperation between a touch coordinate value for adjusting the adjustmenttarget attribute and a touch coordinate value of a touch input that isfirst applied after a key input relative to the button having the keyvalue to which the adjustment target attribute is allocated is acquired.

The controller may generate the second touch signal according to a touchcoordinate value acquired while the detected touch input is maintainedin addition to the key input relative to the button having the key valueto which the adjustment target attribute is allocated.

The controller may generate the second touch signal on the basis of atouch coordinate value of a touch input detected by an electrode of thebutton having the key value to which the adjustment target attribute isallocated.

The controller may generate a second touch signal for indicating any oneof an increase and a decrease in the attribute value when the touchinput detected by the electrode of the button having the key value towhich the adjustment target attribute is allocated is in acounter-clockwise direction, and may generate a second touch signal forindicating the other of the increase and decrease in the attribute valuewhen the touch input detected by the electrode of the button having thekey value to which the adjustment target attribute is allocated is in aclockwise direction.

According to yet another aspect of the present invention, there may beprovided an electronic device having a multi-functional human interfacewith a keyboard layout, the electronic device including a plurality ofbuttons arranged according to the keyboard layout and each having akeycap configured to receive a vertical push input from a user; a buttonbody combined with a lower portion of the keycap and configured to bemoved downward according to the push input; and an electrode interposedbetween the keycap and the button body and configured to receive a touchinput from the user by means of a first block group composed of blocksthat are electrically connected in a first direction, which is any oneof a length direction and a width direction of the keyboard layout, anda second block group composed of blocks that are electrically connectedin a second direction different from the first direction, which is theother one of the length direction and the width direction of thekeyboard layout; a plurality of switches arranged in lower portions ofthe plurality of buttons according to the keyboard layout and eachconfigured to acquire a key input when the button body is moveddownward; an electric connection member configured to electricallyconnect the first block group among buttons arranged in the firstdirection to form a drive line, which applies a drive signal forinducing capacitance in the electrode, and electrically connect thesecond block group among buttons arranged in the second direction toform a scan line, which receives a scan signal for detecting a changecaused by the touch input in the capacitance induced in the electrode bythe drive signal, in order to electrically connect the electrode amongthe buttons; and a controller configured to acquire a key valueallocated to a button corresponding to a switch that acquires the keyinput and acquire a touch coordinate value calculated using the changein the capacitance of the electrode corresponding to the touch input,wherein the controller may determine the keyboard mode or the touch modewhen a key input is acquired, output a character value corresponding tothe key input when the keyboard mode is determined, and operate in anattribute adjustment mode in which the touch input is used to adjust aspecific attribute value when the touch mode is determined.

The controller may enter the attribute adjustment mode when a key inputis generated in the touch mode, and may return to the touch mode when akey input is generated in the attribute adjustment mode.

The controller may maintain the attribute adjustment mode while a keyinput is maintained in the touch mode.

The controller may use a one-time touch input applied after a key inputis generated in the touch mode to adjust the specific attribute value.

According to yet another aspect of the present invention, there may beprovided a control method of an electronic device having amulti-functional human interface with a keyboard layout, wherein theelectronic device includes a plurality of buttons arranged according tothe keyboard layout and each having a keycap configured to receive avertical push input from a user; a button body combined with a lowerportion of the keycap and configured to be moved downward according tothe push input; and an electrode interposed between the keycap and thebutton body and configured to receive a touch input from the user bymeans of a first block group composed of blocks that are electricallyconnected in a first direction, which is any one of a length directionand a width direction of the keyboard layout, and a second block groupcomposed of blocks that are electrically connected in a second directiondifferent from the first direction, which is the other one of the lengthdirection and the width direction of the keyboard layout; a plurality ofswitches arranged in lower portions of the plurality of buttonsaccording to the keyboard layout and each configured to acquire a keyinput when the button body is moved downward; an electric connectionmember configured to electrically connect the first block group amongbuttons arranged in the first direction to form a drive line, whichapplies a drive signal for inducing capacitance in the electrode, andelectrically connect the second block group among buttons arranged inthe second direction to form a scan line, which receives a scan signalfor detecting a change caused by the touch input in the capacitanceinduced in the electrode by the drive signal, in order to electricallyconnect the electrode among the buttons; and a controller configured toacquire a key value allocated to a button corresponding to a switch thatacquires the key input and acquire a touch coordinate value calculatedusing the change in the capacitance of the electrode corresponding tothe touch input, the control method including entering the keyboardmode; ignoring the touch input, and outputting only a keyboard inputreflecting a key value corresponding to the push input when operating inthe keyboard mode; entering the touch mode; outputting a first touchsignal for controlling a position of a pointer according to the touchcoordinate value when operating in the touch mode; receiving a key inputrelative to a button having a key value to which a target controlattribute is allocated while operating in the touch mode; and outputtinga second touch signal for instructing that an attribute value of theadjustment target attribute be adjusted according to the touchcoordinate value.

The control method may further include outputting a signal forinstructing that the adjustment target attribute be activated when thekey for the button having the key value to which the adjustment targetattribute is allocated is acquired while operating in the touch mode.

The activation of the adjustment target attribute may include displayinga graphic object for adjusting the adjustment target attribute.

The generation of a second control method may further include generatingthe second touch signal on the basis of only one of a vertical value anda horizontal value of the touch coordinate value when the adjustmenttarget attribute has a 1D attribute value.

The generation of a second touch signal may include generating thesecond touch signal on the basis of a value corresponding to a movementdirection of an indicator on the graphic object for adjusting theadjustment target attribute, which is one of the vertical value and thehorizontal value of the touch coordinate value.

The generation of a second touch signal may include generating thesecond touch signal on the basis of a difference operation between atouch coordinate value during a current scan period and a touchcoordinate value during a previous scan period.

The control method may further include setting a touch region foradjusting the adjustment target attribute corresponding to a range of anattribute value of the adjustment target attribute.

The setting of a touch region may include setting the touch region suchthat a maximum value of the attribute value of the adjustment targetattribute is matched to a top end or a rightmost side of the touchregion and a minimum value of the attribute value is matched to a bottomend or a leftmost side of the touch region.

The generation of a second touch signal may include generating thesecond touch signal such that the touch coordinate value and the currentattribute value of the adjustment target attribute correspond to eachother.

The generation of a second touch signal may include generating amatching relationship between an attribute value of the adjustmenttarget attribute and a touch coordinate value of a touch input that isfirst applied after a key input relative to the button having the keyvalue to which the adjustment target attribute is allocated is acquired;and generating the second touch signal on the basis of the touchcoordinate value and the matching relationship.

The generation of a second touch signal may include generating thesecond touch signal through a difference operation between a touchcoordinate value for adjusting the adjustment target attribute and atouch coordinate value of a touch input that is first applied after akey input relative to the button having the key value to which theadjustment target attribute is allocated is acquired.

The generation of a second touch signal may include generating thesecond touch signal according to a touch coordinate value acquired whilethe detected touch input is maintained in addition to the key inputrelative to the button having the key value to which the adjustmenttarget attribute is allocated.

The generation of a second touch signal may include generating thesecond touch signal on the basis of a touch coordinate value of a touchinput detected by an electrode of the button having the key value towhich the adjustment target attribute is allocated.

The generation of a second touch signal may include generating a secondtouch signal for indicating any one of an increase and a decrease in theattribute value when the touch input detected by the electrode of thebutton having the key value to which the adjustment target attribute isallocated is in a counter-clockwise direction, and generating a secondtouch signal for indicating the other of the increase and decrease inthe attribute value when the touch input detected by the electrode ofthe button having the key value to which the adjustment target attributeis allocated is in a clockwise direction.

According to yet another aspect of the present invention, there may beprovided a control method of an electronic device having amulti-functional human interface with a keyboard layout includes aplurality of buttons arranged according to the keyboard layout and eachhaving a keycap configured to receive a vertical push input from a user;a button body combined with a lower portion of the keycap and configuredto be moved downward according to the push input; and an electrodeinterposed between the keycap and the button body and configured toreceive a touch input from the user by means of a first block groupcomposed of blocks that are electrically connected in a first direction,which is any one of a length direction and a width direction of thekeyboard layout, and a second block group composed of blocks that areelectrically connected in a second direction different from the firstdirection, which is the other one of the length direction and the widthdirection of the keyboard layout; a plurality of switches arranged inlower portions of the plurality of buttons according to the keyboardlayout and each configured to acquire a key input when the button bodyis moved downward; and an electric connection member configured toelectrically connect the first block group among buttons arranged in thefirst direction to form a drive line, which applies a drive signal forinducing capacitance in the electrode, and electrically connect thesecond block group among buttons arranged in the second direction toform a scan line, which receives a scan signal for detecting a changecaused by the touch input in the capacitance induced in the electrode bythe drive signal, in order to electrically connect the electrode amongthe buttons, the control method comprising: determining the keyboardmode or the touch mode when a key input is acquired, outputting acharacter value corresponding to the key input when the keyboard mode isdetermined, and operating in the attribute adjustment mode in which thetouch input is used to adjust a specific attribute value when the touchmode is determined.

The control method may further include entering the attribute adjustmentmode when a key input is generated in the touch mode and returning tothe touch mode when a key input is generated in the attribute adjustmentmode.

The control method may further include maintaining the attributeadjustment mode while a key input is maintained in the touch mode.

A one-time touch input applied after a key input is generated in thetouch mode may be used to adjust the specific attribute value.

According to yet another aspect of the present invention, there may beprovided an electronic device that has a multi-functional humaninterface with a keyboard layout and is used as an input interface for aplurality of output devices in a multi-device environment, theelectronic device including a plurality of buttons arranged according tothe keyboard layout and each having a keycap configured to receive avertical push input from a user; a button body combined with a lowerportion of the keycap and configured to be moved downward according tothe push input; and an electrode interposed between the keycap and thebutton body and configured to receive a gesture input including a touchoperation or a hovering operation from the user by means of a firstblock group composed of blocks that are electrically connected in afirst direction, which is any one of a length direction and a widthdirection of the keyboard layout, and a second block group composed ofblocks that are electrically connected in a second direction differentfrom the first direction, which is the other one of the length directionand the width direction of the keyboard layout; a plurality of switchesarranged in lower portions of the plurality of buttons according to thekeyboard layout and each configured to acquire a key input when thebutton body is moved downward; an electric connection member configuredto electrically connect the first block group among buttons arranged inthe first direction to form a drive line, which applies a drive signalfor inducing capacitance in the electrode, and electrically connect thesecond block group among buttons arranged in the second direction toform a scan line, which receives a scan signal for detecting a changecaused by the gesture input in the capacitance induced in the electrodeby the drive signal, in order to electrically connect the electrodeamong the buttons; and a controller configured to acquire a key valueallocated to a button corresponding to a switch that acquires the keyinput, determine that the gesture input is a touch input when the amountof change in the capacitance is greater than a touch threshold,calculate a touch coordinate value from the change in the capacitancecaused by the touch input, output a first signal indicating that apointer moved on a control target screen, which is one of the pluralityof output devices, on the basis of the calculated touch coordinatevalue, determine that the gesture input is a hovering input when theamount of change in capacitance is less than the touch threshold andgreater than a hovering threshold, calculate a hovering coordinate valuefrom the change in the capacitance according to the hovering input, andoutput a second signal indicating that a virtual point moved in avirtual space, an actual space, or an augmented space on the basis ofthe calculated hovering coordinate value.

When a touch input is acquired while the virtual pointer correspondingto the second signal is located at a position corresponding to any oneof the output devices, the controller may set the output device as acontrol target.

The multi-device environment may further include a virtual or augmentedobject.

When a touch input is acquired while the virtual pointer correspondingto the second signal is located at a position corresponding to thevirtual or augmented object, the controller may set the object as thecontrol target.

The multi-device environment may further include a head mounted display(HMD) for processing virtual reality (VR) or augmented reality (AR), andthe second signal may indicate a position of a virtual pointer displayedon the HMD.

According to yet another aspect of the present invention, there may beprovided a control method of an electronic device that has amulti-functional human interface with a keyboard layout and is used asan input interface for a plurality of output devices in a multi-deviceenvironment, wherein the electronic device includes a plurality ofbuttons arranged according to the keyboard layout and each having akeycap configured to receive a vertical push input from a user; a buttonbody combined with a lower portion of the keycap and configured to bemoved downward according to the push input; and an electrode interposedbetween the keycap and the button body and configured to receive a touchinput from the user by means of a first block group composed of blocksthat are electrically connected in a first direction, which is any oneof a length direction and a width direction of the keyboard layout, anda second block group composed of blocks that are electrically connectedin a second direction different from the first direction, which is theother one of the length direction and the width direction of thekeyboard layout; a plurality of switches arranged in lower portions ofthe plurality of buttons according to the keyboard layout and eachconfigured to acquire a key input when the button body is moveddownward; and an electric connection member configured to electricallyconnect the first block group among buttons arranged in the firstdirection to form a drive line, which applies a drive signal forinducing capacitance in the electrode, and electrically connect thesecond block group among buttons arranged in the second direction toform a scan line, which receives a scan signal for detecting a changecaused by a gesture input in the capacitance induced in the electrode bythe drive signal, in order to electrically connect the electrode amongthe buttons, the control method comprising: acquiring a key valueallocated to a button corresponding to a switch that acquires a keyinput and outputting a keyboard input reflecting the key value;determining that the gesture input is a touch input when the amount ofchange in the capacitance is greater than a touch threshold; calculatinga touch coordinate value from the change in the capacitance caused bythe touch input; outputting a first signal indicating that a pointermoved on a control target screen, which is one of the plurality ofoutput devices, on the basis of the calculated touch coordinate value;determining that the gesture input is a hovering input when the amountof change in capacitance is less than the touch threshold and greaterthan a hovering threshold; calculating a hovering coordinate value fromthe change in the capacitance according to the hovering input; andoutputting a second signal indicating that a virtual point moved in avirtual space, an actual space, or an augmented space on the basis ofthe calculated hovering input.

The method may further include: acquiring a touch input when the virtualpointer corresponding to the second signal is located at a positioncorresponding to any one of the output devices; and setting the outputdevice as a control target.

The multi-device environment may further include a virtual or augmentedobject, and the method may further include: acquiring a touch input whenthe virtual pointer corresponding to the second signal is located at aposition corresponding to the virtual or augmented object; and settingthe object as a control target.

The multi-device environment may further include an HMD for processingVR or AR, and the second signal may indicate a position of a virtualpointer displayed on the HMD.

The present inventive concept relates to a human interface: forreceiving, from a user, an input of text information or pointinglocation information at a digital device capable of receiving the textinformation or pointing location information, such as a computer, anotebook, a tablet PC, and a portable phone; and transmitting thereceived information to the digital device.

A keyboard formed of a plurality of buttons connected to an elastic bodyand a switch has widely been used as an existing text information inputdevice.

Furthermore, a digital device having a touch interface employs a methodin which a virtual keyboard is displayed on a display, and when a partof user body touches the virtual keyboard displayed on the display, auser's gesture or an electrical signal is sensed, and then the text onthe virtual keyboard displayed on the part touched by the user may beinput.

The touch interface may recognize the user touch by recognizing movementof the part of user body, by recognizing contact with a specific contactsurface, by sensing a flow of current through the user body, or bysensing light, sound waves or the like from being blocks or interferedwith the part of user body.

Examples of the touch interface include a pressure sensing touch screen,a capacitive touch screen, an optical touch screen, and an ultrasonictouch screen.

A resistive touch screen or the pressure sensing touch screen operatesby recognizing pressure.

The resistive touch screen is known to have advantages in terms of lowcost, a stylus pen for writing, and greater precision for writingletters in a small space, but also known to have disadvantages in that,since the resistive touch screen uses pressure, heavy pressing may notbe recognized, and the feeling of touch may be slightly dull as comparedwith the capacitive touch screen.

The resistive touch screen may be formed of multiple layers.

Among the multiple layers, a conductive layer is formed of two layersfacing each other with an air layer therebetween.

When an outer screen is pressed, the two layers of the conductive layercontact each other, which causes change in resistance and current andthus enables a touch to be recognized.

A capacitive sensing or capacitive touch method senses an operation byusing capacitive coupling effects.

Unlike the pressure sensing touch screen using pressure, the capacitivetouch screen is made of indium tin oxide, which is glass having highconductivity.

The glass has sensors attached to four edges thereof, causing current toflow along the surface of the glass.

The capacitive touch method recognizes changes in the current throughthe sensors attached to fore edges.

Upon touching the screen with a finger of the user, electrons flowingalong the glass flow into the body of the user through finger, and thesensors sense the location where changes occur so as to operate thecapacitive touch screen.

The capacitive touch screen is known to allow smoother feeling ofmanipulation and scroll as compared with the pressure sensing touchscreen since the capacitive touch screen does not require heavy pressingon the screen but recognizes even just a slight touch on the screen.

Furthermore, the capacitive touch method allows multi-touch capable oftouching multiple points.

Since the capacitive touch screen operates using an amount of change incurrent, the capacitive touch screen may not be operated with fingerswearing leather gloves which do not conduct current, fingernails, orstylus pens.

However, users may operate the capacitive touch screen by using aseparate dedicated stylus pen.

The sensors may be sensitive and thus can be influenced by peripheraldevices.

The optical touch screen includes an infrared camera and infraredlighting mounted on the vertex thereof so as to measure coordinates bythe shadow of an object to touch the screen.

The ultrasonic touch screen emits ultrasonic waves thereon so as tosense interference effects caused by a user touch and measurescoordinates for operation.

The present inventive concept may employ other various touch inputtechniques which can be used in sensing contact or motion of a user soas to recognize location information of a part of user body and controllocation information of a pointer.

FIG. 1 illustrates an exemplary embodiment of a text input deviceintegrated with a pointing device.

The text input device integrated with a pointing device may include ahousing 100 for supporting the text input device and a pointer locationinformation input region.

The housing may have strength sufficient for enduring pressure of userinput, and include a control unit, a memory unit, a battery unit, anencoding unit, a transmitting unit, and the like so as to receive textinput information and pointer location information input information andtransmit corresponding information to a digital device connected to thetext input device integrated with a pointing device in a wired orwireless manner.

The text input device integrated with a pointing device may include aplurality of buttons 109 for receiving text input information from auser.

The plurality of buttons 109 may be formed of physical buttons orvirtual buttons.

Since the physical buttons may be formed of buttons connected to anelastic body, or may be elastic per se, the physical buttons may movewhen an input is received from the user and return to the originallocation when pressure applied from the user is removed.

Since the physical buttons may be connected to an electrical switch, thephysical buttons may move when the pressure is applied from the user anda phase of the electrical switch changes to generate a text input valueof the buttons.

The physical buttons may be elastic but may not be connected to anelectrical switch, and may move when the pressure is applied from theuser and return to the original location when the pressure applied fromthe user is removed. The text input information of the user may begenerated by the touch input device on the basis of the locationinformation in which the pressure or gesture of the user is recognized.

The virtual buttons may be text input buttons displayed on a displaydevice.

The virtual buttons may be certain buttons displayed by projecting lightto a transparent or semi-transparent object.

The virtual buttons may not be recognized by user's eye, and may haveunique location information for each text and generate relevant textinput information on the basis of a user's pressure or gestureinformation.

The text input device integrated with a pointing device may have a textinput region 107 and pointing location information input regions 108 aand 108 b having at least a part thereof shared with the text inputregion 107.

The pointing location information input regions 108 a and 108 b may belocated at a surface, a top, or a bottom of the button for inputtingtext, and as shown in FIG. 1 , the pointing location information inputregions 108 a and 108 b may have at least a part thereof shared with thetext input region 107.

The pointing location information input regions 108 a and 108 b mayinclude the text input region 107, or the text input region 107 mayinclude the pointing location information input regions 108 a and 108 b.

The pointing location information input regions 108 a and 108 b and thetext input region 107 may have at least a part thereof sharedtherebetween, and the at least a part thereof may be used as thepointing location information input regions 108 a and 108 b but not asthe text input region 107, and the at least a part thereof may be usedas the text input region 107 but not as the pointing locationinformation input regions 108 a and 108 b.

The text input device integrated with a pointing device may include apointer location information input device 105 for forming a virtual textinput region or a virtual pointing location information input region forinputting text, pointing location information, or both the text andpointing location information, the pointer location information inputdevice 105 being disposed on or outside the text input device integratedwith a pointing device.

The pointer location information input device 105 such as an infraredray generator and an infrared ray receiver, an RGB camera, an ultrasonicgenerator and an ultrasonic receiver, or an infrared ray generator andan infrared camera may sense a part of user body on a surface of orabove the housing 100 so as to receive location information and gestureinformation.

The pointer location information input device 105 may be formed into aplurality of devices so as to extend the pointer location informationinput region or improve accuracy and sensitivity of the pointer locationinformation input region.

For example, a pointer location information input device 105 b may beprovided to allow text input by a right hand or for the pointinglocation information input region 108 b for the right hand.

Furthermore, a pointer location information input device 105 a may beprovided to allow text input by a left hand or for the pointing locationinformation input region 108 a for the left hand.

The text input region for the right hand or the pointing locationinformation input region 108 b for the right hand may include a regionof letter J button on a standard English keyboard.

The text input region for the left hand or the pointing locationinformation input region 108 a for the left hand may include a region ofletter F button on a standard English keyboard.

The pointer location information input device 105 may include both theregion of letter J button and the region of letter F button on astandard English keyboard.

When the text input device integrated with a pointing device isconnected to a plurality of digital devices having display units, thepointing location information input regions 108 a and 108 b may allow apointer to be movable on the plurality of display units.

For example, the pointing location information input region may bedivided so as to be matched with respective display units, or a separatebutton indicating the display units may operate so as to transmitpointer location information from a relevant display unit, or theplurality of display units may be recognized as a virtual single displayunit and the pointer location information may be transmitted such that apointer can move on the virtual single display unit.

The text input device integrated with a pointing device may include apointing location information input device having a pointing inputregion and receiving pointer location information from a user; andpointer execution instruction units 101 and 102 for executing at leastone function on a button, image, space, icon, or a text input window onwhich the pointer moved by the pointing location information inputdevice is located.

The pointer execution instruction units 101 and 102 may be formed of oneor two buttons, perform respectively first and second functions, andlocated at a left side, a right side, or a center of the housing.

The first function may be, for example, a left click function of acomputer mouse, and the second function may be, for example, arightclick function of a computer mouse.

The pointer execution instruction units formed of one or two buttons maybe located at both the left and right sides of the housing, providinguse convenience to both left-handed and right-handed persons.

The pointer execution instruction units 101 and 102 may operate by atouch of a part of user body, light blocking, interference of ultrasonicwaves, or recognition of a shadow of a part of user body through the useof the touch techniques described above.

The pointer execution instruction units 101 and 102 may be formed ofelastic physical buttons.

The pointer execution instruction units 101 and 102 may operate by usingat least one of text buttons disposed in a text input region outside apointing location information input region.

The pointer execution instruction units 101 and 102 may operate byselecting a physical or virtual text button on the pointing locationinformation input region.

For example, when a virtual input device is used as a pointing locationinformation input device and a physical button is used as a text inputdevice, pointer location information may be input on a virtual pointinglocation information input region and the physical text button locatedat the corresponding location may be pressed so as to generate a pointerexecution instruction in a pointing location information input mode.

The pointer execution instruction units 101 and 102 may receive pointerlocation information by a first user gesture in the pointing locationinformation input region, and generate a pointer execution instructionby a second user gesture at the same location.

The pointer execution instruction units 101 and 102 may enable a firstfunction to be performed by a first gesture of a user body, a firstvoice, a first eye blinking, a first mouth shape, or the like.

The pointer execution instruction units 101 and 102 may enable a secondfunction to be performed by a second gesture of a user body, a secondvoice, a second eye blinking, a second mouth shape, or the like.

The text input device integrated with a pointing device may operate in atext input mode for receiving text information through the text inputdevice, and a pointing location information input mode for receivingpointing location information through the pointing location informationinput device.

Both the text input mode and the pointing location information inputmode may be switched by a mode switching unit 103.

The mode switching unit 103 may be formed of a switch located separatelyon the housing.

The mode switching unit 103 may perform mode switching by sensing aninput received through at least one text input button of the text inputdevice, or simultaneous receptions of a plurality of text inputs.

The mode switching unit 103 may switch modes by receiving controlinformation from the digital device connected to the text input deviceintegrated with a pointing device in a wired or wireless manner.

The mode switching unit 103 may be formed integrally with the pointerexecution instruction unit 102.

For example, a first touch or first pressure by a first gesture such asa contact of a part of user body on the pointer execution instructionunit 102 which shows a primary reaction to the first touch or firstpressure and a secondary reaction to a second touch or second pressuremay be sensed so as to switch modes, and a reaction to the second touchor second pressure by a second gesture such as a button pressing gesturemay generate a pointer execution instruction.

The mode switching unit 103 may include a temporary switching mode and apermanent switching mode.

For example, the temporary switching mode may be set in which a textinput mode is switched to a pointing location information input mode inreaction to the first touch or first pressure, and the pointing locationinformation input mode is switched again to the text input mode when thefirst touch or first pressure is removed.

Alternatively, the temporary switching mode may be set in which apointing location information input mode is switched to a text inputmode in reaction to the first touch or first pressure, and the textinput mode is switched again to the pointing location information inputmode when the first touch or first pressure is removed.

The permanent switching mode may be set in which a text input mode isswitched to a pointing location information input mode in reaction tothe second touch or second pressure, and the pointing locationinformation input mode is maintained when the second touch or secondpressure is removed.

The temporary mode switching can be performed by first controlinformation received from the digital device connected to the text inputdevice integrated with a pointing device in a wired or wireless manner.

The permanent mode switching can be performed by second controlinformation received from the digital device connected to the text inputdevice integrated with a pointing device in a wired or wireless manner.

The mode switching unit 103 may be formed integrally with the pointerexecution instruction unit.

For example, temporary mode switching may be performed from the textinput mode to the pointer location information input mode when the firsttouch or first pressure is sensed on the pointer execution instructionunit, a pointer execution instruction may be generated when the secondtouch or second pressure is sensed, and the permanent switching mode maybe set when a third touch or third pressure is applied, so as to operatein the pointer location information input mode even when the third touchor third pressure is removed.

In this case, the pointer execution instruction may be input in thepermanent switching mode.

Mode switching units 106 a and 106 b may be provided to a left side or aright side of the housing.

The mode switching units 106 a and 106 b provided to the left side,right side, or both left and right sides may be formed of a virtualbutton or physical button so as to operate by sensing a user touch inputor pressure.

The mode switching units 106 a and 106 b provided to the left side,right side, or both left and right sides may have an input region equalto or larger than 3 centimeters and smaller than 15 centimeters alongthe side surface of the housing.

The text input device integrated with a pointing device may include atransmitting unit 104 for transmitting data wiredly or wirelessly to theoutside or a digital device having the text input device integrated witha pointing device.

The digital device may receive text input or pointer locationinformation.

FIG. 2 is flowchart illustrating an exemplary embodiment of an operationsequence according to mode switching between a pointing device and atext device.

The text input device integrated with a pointing device may have aseparate power unit, or receive power wiredly or wirelessly from anexternal source, and have a separate switch for controlling the powerunit.

When power is supplied to the text input device integrated with apointing device by the switch for controlling the power unit, it may bedetermined whether the text input device integrated with a pointingdevice is currently in a text input mode or a pointing locationinformation input mode (200).

If it is determined that the text input device integrated with apointing device is in a text input mode, the text input deviceintegrated with a pointing device may be activated to receive text inputfrom a user (201).

The text input from the user may be transmitted to the digital devicewhich is connected in a wired or wireless manner.

The text input mode may be switched to the pointing location informationinput mode during an operation of the text input device integrated witha pointing device in the text input mode.

Alternatively, a text input operation and a pointing locationinformation input operation may be simultaneously performed.

When the mode is switched to the pointing location information inputmode, pointing location information may be input from a user (204).

The input pointing location information may be transmitted to thedigital device which is connected in a wired or wireless manner (205).

When the text input device integrated with a pointing device receives afirst pointer execution instruction (206), the text input deviceintegrated with a pointing device may transmit the received firstpointer execution instruction to the digital device which is connectedin a wired or wireless manner (207).

When the text input device integrated with a pointing device receives asecond pointer execution instruction (208), the text input deviceintegrated with a pointing device may transmit the received secondpointer execution instruction to the digital device which is connectedin a wired or wireless manner (209).

When temporary mode switching or permanent mode switching is cancelled,the text input device integrated with a pointing device may be switchedto a text input mode.

The operation may end when power of the text input device integratedwith a pointing device is cut off by the power switch of the power unit,when no digital device is connected, when disconnected, when user inputis absent for a certain time, or by a control of the digital devicewhich is connected in a wired or wireless manner.

FIG. 3 illustrates exemplary embodiments of configurations of text inputdevices and pointing devices.

The text input device integrated with a pointing device may include afirst housing 301 including a power unit, a control unit, acommunication unit or the like; and a second housing 302 having a textinput region and a pointing location information input region.

The text input device integrated with a pointing device may have a textinput device and a text input region 303 for receiving text input from auser.

The text input region 303 may be formed of a virtual button or aphysical button.

The pointing location information input device may be formed into a formof a pressure sensing or capacitive touch pad and positioned on thephysical button of the text input device (304).

When the text input device is formed into a form of a physical touch padsuch as a pressure sensing or capacitive touch pad, the touch pad may beused as a text input device and a pointing location information inputdevice of which modes may be switched by the mode switching unit.

The physical touch pad such as a pressure sensing or capacitive touchpad may be used as a large-area touch pad type text input deviceintegrated with a pointing device 300 formed of a touch pad 304including a plurality of text button regions of a text input unit.

Alternatively, the physical touch pad such as a pressure sensing orcapacitive touch pad may be used as a multi-touch pad type text inputdevice integrated with a pointing device 310 formed of a plurality oftouch pads 311 including one text button region of a text input unit.

Alternatively, the physical touch pad may be used as a top camera typetext input device integrated with a pointing device 320 which receives(321) a pointing location information input by an infrared camera or anRGB camera 222 provided on a top of the pointing location informationinput region.

The top camera type text input device integrated with a pointing device320 may form a virtual text input button 303 by using the top camera.

The physical touch pad may be used as a bottom camera 332 type textinput device integrated with a pointing device 330 in which the camerais provided at a bottom of the second housing so as to receive (331) apointing location information input.

The bottom camera type text input device integrated with a pointingdevice 330 may form the virtual text input button 303 substituting for aphysical text button by using the bottom camera.

The physical touch pad may be used as a transmitting/receiving textinput device integrated with a pointing device 340 which receives apointing location information input through a virtual pointing locationinformation input region 341 formed of a pair of infrared ray receiversor ultrasonic receivers for receiving information in which infrared raysor ultrasonic waves transmitted from an infrared ray transmitter or anultrasonic receiver are blocked or interfered with a part of user body.

The virtual pointing location information input region 341 formed of apair of infrared ray receivers or ultrasonic receivers may be used as avirtual text button input means in place of a physical text button bythe mode switching unit.

FIG. 4 illustrates exemplary embodiments of a mode switching unitintegrated with a pointer execution instruction unit.

A mode switching unit integrated with a pointer execution instructionunit 400 using a touch input includes a button type pointer executioninstruction unit including an elastic body 403 moving by pressureapplied from a user and returning to an original location when thepressure is removed; a button 402 for receiving the pressure appliedfrom the user; and switches 404 and 405 moving and contacting each otherby the pressure from the user so as to generate a pointer executioninstruction, and a mode switching unit 401 is provided on a top of thebutton 402 so as to sense an input of user touch and switch between atext mode and a pointing location information input mode.

A pressure-discriminating mode switching unit integrated with a pointerexecution instruction unit 410 includes a button type pointer executioninstruction unit including the elastic body 403 moving by pressureapplied from a user and returning to an original location when thepressure is removed; the button 402 for receiving the pressure appliedfrom the user; first switches 404 and 405 moving and contacting eachother by first pressure from the user so as to generate a pointerexecution instruction; and second switches 411 and 412 contacting eachother by second pressure from the user smaller than the first pressurefrom the user so as to generate a mode switching execution instruction.

The button 402 may move and be fixed such that the button 402 may notreturn to its original location by the elastic body 403 in thepressure-discriminating mode switching unit integrated with a pointerexecution instruction unit 410.

In this case, the button 402 may be fixed at a location in which thesecond switches 411 and 412 contact each other but the first switches404 and 405 do not contact each other so as to operate in a permanentswitching mode when the button 402 is fixed.

The mode switching unit integrated with a pointer execution instructionunit 400 using a touch input may be configured to operate a permanentmode switching switch 414 by an operation such as button sliding, andthe pointer execution instruction switches 404 and 405 operate whenadditional pressure is applied while operating the permanent modeswitching switch 414.

The mode switching unit integrated with a pointer execution instructionunit 410 may be formed of a touch pad 421 which operates as a modeswitching unit when an area of a part of user body contacting the touchpad 421 is within a first predetermined range and as a pointer executioninstruction unit when the area is within a second predetermined range.

FIG. 5 illustrates an exemplary embodiment of a pointer locationinformation input region.

A human interface device of the present inventive concept may bedesigned to further include pointer location information input regiondisplay units 701 and 701 for visually displaying the pointer locationinformation input region in a pointer location information input mode.

A mode switching unit of the present inventive concept may be providedseparately from the button of the text input unit, and designed torecognize that a part of user body touches a part of a human interfacebody and switch between the text input mode and the pointer locationinformation input mode, such that the human interface operates in thepointer location information input mode when the part of user bodytouches and in the text input mode when the part of user body does nottouch.

In this case, the mode switching unit may be designed such that, if thepart of user body used for the mode switching is a right hand (106 b),then a left hand may input the pointer location information (108 a).

In this case, it may be preferable that the pointer location informationinput region is closer to the edge opposite to the edge at which themode switching unit is positioned, and if a user uses his/her left handand right hand contrariwise, the mode switching unit may be designedfollowing the same principle (106 a and 108 b).

The mode switching unit may be designed such that the part of user bodyused for the mode switching is a right hand and the right hand alsoinputs the pointer location information.

In this case, it may be preferable that the pointer location informationinput region is closer to the edge at which the mode switching unit ispositioned than to the edge opposite to the edge at which the modeswitching unit is positioned, and if the part of user body used for themode switching is a left hand and the left hand also inputs the pointerlocation information, the mode switching unit may be designed followingthe same principle.

The mode switching unit may determine the text input mode and thepointer location information input mode by the number of the fingers ofthe user recognized by the pointer location information input unit.

The number of the fingers of the user recognized as the pointer locationinformation input mode may be smaller than the number of the fingers ofthe user recognized as the text input mode.

For example, a left finger may not touch the text input button and aright index finger may touch the button for inputting pointer locationinformation while controlling the mode switching unit by a left hand,and in this case, the number of the fingers of the user recognized maybe one.

On the contrary, when the fingers of the left hand and right hand toucha keyboard so as to input text, the number of the fingers of the userrecognized may be two to eight.

The pointer location information input mode display unit may temporarilydisplay a pointer location information input mode when a mode isswitched to the pointer location information input mode by the modeswitching unit, or may visually display the pointer location informationinput region from the time of switching to the pointer locationinformation input mode to the time of cancellation.

The pointer location information input mode display unit may display themode by the reflected light from the text input button or by the textinput button by a visible ray generator, or through spacing between thetext input buttons.

The pointer location information input mode display unit may includeinvisible ray generators 701 a and 701 b, and surfaces 702 a and 702 bon which dye optically reacting to the invisible rays so as to emitvisible rays is applied, and the dye may be applied to the text inputbutton or the spacing between the text input buttons.

The mode switching unit may further include a hand side determinationunit for determining whether the user inputs the pointer locationinformation by the left hand or the right hand.

The display region of the pointer location information input modedisplay unit may be flexibly displayed according to the determination ofthe hand side determination unit.

The arrangement and operation of the buttons of the pointer executioninstruction unit may be fluidly switched according to the determinationof the hand side determination unit.

For example, if the pointer execution instruction unit includes a mouseright click and a mouse left click, the button to perform the mouseright click and the mouse left click may be switched according to thedetermination of the hand side determination unit.

The pointer location information input region display unit may displaydifferent pointer location information input regions (702 a and 702 b)according to the determination result of the hand side determinationunit.

The mode switching unit may be designed to automatically switch to thetext input mode when the pointer location information is not inputtedfrom a user for a predetermined time or an input is received through thetext input button during the pointer location information input mode.

The pointer location information input region display unit may beconfigured in that dye is applied to a part of the text input button orthe text input region so as to visually display regardless of the modeswitched by the mode switching unit, such that the pointer input regioncan be recognized during the text input mode.

FIG. 6 illustrates an exemplary embodiment of a mode switching unitintegrated with a pointer execution instruction unit.

An inputting operation which requires frequent switching between thetext input mode and the pointer location information input mode alsorequires increased frequency of mode switching and pointer executioninstruction inputting.

For example, when a right-handed user intends to input pointer locationinformation while inputting text in a text input mode, the user needs toswitch the mode by the left or right hand, input the pointer locationinformation, and then input the pointer execution instruction to thepointer execution instruction unit by the left hand.

In general, users may input text, pointer location information, andpointer execution instruction with their eyes kept on a monitor in abusy working environment, and when the mode switching unit and thepointer execution instruction input unit are provided separately fromeach other, the users need to move their hands frequently, and thus theusers may not find an accurate location, resulting in a failure of workperformance, or the users may need to see the keyboard, making worktroublesome.

To solve these problems, if a right-handed user, for example, puts,after inputting text in a text input mode, his/her left hand on the modeswitching unit, a mode switching instruction is generated to switch to apointer input mode. Furthermore, if the user inputs pointer locationinformation by his/her right hand with his/her left hand kept on themode switching unit, and then applies pressure to the mode switchingunit, the pointer execution instruction unit receives input of the user.

Thus, users may share the location of the mode switching unit for modeswitching and the location of the pointer execution instruction unit forpointer execution instruction.

As one exemplary embodiment, the mode switching unit may be formed of atouch switch capable of receiving an input of a user hand touch, and thepointer execution instruction unit may be formed of a switch reacting topressure such as a tact switch, and positioned beneath the modeswitching unit.

A first pointer execution instruction unit 1104 and a second pointerexecution instruction unit 1105 may be interconnected by a conductormaterial capable of recognizing a touch from a user hand, or commonlyconnected to a mode switching unit 1201 such that mode switching can beperformed identically when the user touches either the first pointerexecution instruction unit 1104 or the second pointer executioninstruction unit 1105.

In this case, an operation is performed in a pointer locationinformation input mode during a touch, and in a text input mode when thetouch is cancelled.

A mode switching operation by a touch may be performed by a switch otherthan the touch, operating with pressure smaller than the pressure for apointer execution instruction, or a sensor capable of sensing thelocation of user's finger.

In this case, the mode switching unit and the pointer executioninstruction unit may be disposed in a region different from the textinput region. Preferably, for a right-handed person, the mode switchingunit and the pointer execution instruction unit may be disposed in aleft outside of the text input region. When the mode switching unit andthe pointer execution instruction unit are disposed outside the textinput region, the possibility of confusion arising from the pointerlocation information input unit and pointer location information inputmay be eliminated, and the pointer location information input region maybe extended.

The multi-functional human interface device of the present inventiveconcept may include a second mode switching unit 1202. The second modeswitching unit 1202 may operate together with a toggle switch, andswitch between the text input mode and the pointer location informationinput mode whenever an input is received from a user. This enables theuser to input pointer location information just by his/her right handeven when the left hand of the user is not in touch with the modeswitching unit.

In this case, the multi-functional human interface device of the presentinventive concept may operate in a pointer location information inputmode upon receiving a mode switching instruction by a touch when themulti-functional human interface device is in a text mode by the secondmode switching unit 1202. Furthermore, the multi-functional humaninterface device may be maintained in a pointer location informationinput mode upon receiving a mode switching instruction by a touch whenthe multi-functional human interface device is in a pointer locationinformation input mode by the second mode switching unit 1202, but themulti-functional human interface device is switched to a text input modewhen a mode switching instruction by a touch is cancelled or a textinput is received through the text input unit.

When the multi-functional human interface device is switched to a textinput mode by a text input, at least a first text input may be ignored,and the multi-functional human interface device may be switched to thetext input mode upon receiving at least two text inputs.

When the multi-functional human interface device is switched to the textinput mode upon receiving at least two text inputs, the multi-functionalhuman interface device may transmit, to the digital device, text inputsincluding the ignored at least first text, and then transmit newly inputtext input information to the digital device.

FIG. 7 illustrates an exemplary embodiment of a utilization of a humaninterface device cover.

In the multi-functional human interface device, the pointer locationinformation input device may require a space of at least 1 mm to 2 mm ona plane of the text input device formed into a physical device so as toform a pointer location information input region, and require a rim inwhich an absorber or a reflector for absorbing or reflecting an opticalsignal is positioned, at edges of at least three sides enclosing a textinput region.

In this case, a gap of at least 1 mm to 2 mm is formed between theheight of the rim of the at least three sides and the plane of the textinput region, and a substantially rectangular space is formed in thegap.

The multi-functional human interface device of the present inventiveconcept may further include a multi-functional cover 1322 in thesubstantially rectangular space so as to protect the text input regionfrom impact applied from outside (1310).

The multi-functional cover 1322 may be separated from themulti-functional human interface device, and may be coupled or decoupledto or from the multi-functional human interface device by a magnet or aphysical structure.

The multi-functional cover 1322 may be foldable several times.Preferably, the multi-functional cover 1322 may have a twice-foldablestructure, and the width of at least one of divided regions of themulti-functional cover 1322 may be narrower than the width of otherregions (1341).

This may further reduce the slope of the multi-functional humaninterface device when the multi-functional cover 1322 is folded anddisposed beneath the multi-functional human interface device so as toadjust the slope of the multi-functional human interface device.

When the multi-functional cover 1322 is folded and disposed beneath themulti-functional human interface device, the portion contacting theground among the part of the folded surface may have a tilted surface(1342) for increasing an area contacting the ground.

The slope of the multi-functional human interface device may be adjustedaccording to a user's desire by the number of folding of themulti-functional cover 1322.

The multi-functional cover 1322 may have a built-in charge battery 1323therein.

The charge battery 1323 may have power with an electrode which isdisposed in a part of the region protruding further than a part coveringthe text input region, covering the rim of the part covering the textinput region beneath the multi-functional cover 1322 (1331), and thepower may be connected to an electrode provided on the top of themulti-functional human interface device when the text input device iscovered with the multi-functional cover 1322 (1310).

When the multi-functional cover 1322 is folded and disposed beneath themulti-functional human interface device to as to adjust the slope of themulti-functional human interface device, the power of the charge battery1323 may be connected to an electrode provided at a bottom surface ofthe multi-functional human interface device.

The multi-functional human interface device may be connected to externalpower so as to supply power to the charge battery 1323 in themulti-functional cover 1322 or separately charge the multi-functionalcover 1322.

In this case, the bottom surface of the multi-functional human interfacedevice may have a groove to which a magnet, a physical coupling device,or a cover is inserted such that the multi-functional human interfacedevice can be coupled/decoupled, at an accurate location, to/from theprotruded rim region in which the electrode 1331 is disposed and to/froma region 1332 covering the text input region having a gap differencefrom the protruded rim region.

A material capable of removing fine dust, oil stain, moisture, and thelike can be applied to the rim of the multi-functional cover 1322, andthus foreign substances can be removed from an absorber plate, areflector plate, an optical emitter, or a front surface of a camera whenthe multi-functional cover 1322 is attached/detached to/from themulti-functional human interface device.

When the text input region is covered with the multi-functional cover1322, the cover may be detected so as to turn the power of themulti-functional human interface device off.

When the multi-functional cover 1322 is disposed on the bottom surfaceof the multi-functional human interface device, the power of themulti-functional human interface device may be turned on.

Furthermore, when a user input is absent for a predetermined time afterpower turn-on, the power may be cut off or a mode may be switched to astandby mode.

When the text input region is covered with the multi-functional cover1322 (1310), a multi-functional human interface device 1321 may have asubstantially thin rectangular plate shape, and may be designed to haveno slope when put on the ground, thereby maximizing aesthetic effectsand improving portability.

When the multi-functional cover 1322 is folded and disposed at thebottom surface of the multi-functional human interface device, themulti-functional human interface device may have a slope similar tothose of general keyboards.

The multi-functional cover 1322 may be attachable/detachable, butalternatively, may be designed to descend round from the top to thebottom of the multi-functional human interface device by a hinge andfolded.

FIG. 8 illustrates an exemplary embodiment of a human interface deviceapplied to a portable notebook.

A human interface device 1420 of the present inventive concept may beused as an input device of a portable notebook.

The portable notebook having the human interface device of the presentinventive concept may be designed in that a display unit including adisplay panel 1411 and a frame 1410 supporting the display panel 1411 isconnected to the human interface device of the present inventive conceptby a hinge 1427 such that the portable notebook can be folded andunfolded.

In this case, the display unit may be inserted to an inside of a wallformed by a reflector plate or absorber plate 1424 of the humaninterface device of the present inventive concept. Thus, the thicknessof the portable notebook using the human interface device of the presentinventive concept may be minimized.

To this end, the display unit of the portable notebook may have a widththat needs to be at least two times thickness of the reflector plate1423 or absorber plate 1424 shorter than the width of the humaninterface device 1420 of the present inventive concept.

That is, the display unit needs to be designed so as to be inserted intothe place in which the multi-functional cover is inserted, as shown inFIG. 13 .

The display unit may have both corners rounded or diagonally cut (1413).

Pointer location information input devices 1421 and 1422 may bepositioned outside the rounded or diagonally cut corners of the displayunit when the display unit is folded.

Thus, the portable notebook may maintain its thickness thin withoutbeing interfered with the pointer location information input devices1421 and 1422 when the portable notebook is folded.

In this case, a mode switching unit and a pointer execution instructionunit may be provided outside a side surface of the human interfacedevice.

More preferably, the mode switching unit and the pointer executioninstruction unit may be provided outside down the text input region(1425 and 1426).

In this case, it may be preferable that the mode switching unit and thepointer execution instruction unit are integrally formed, as shown inFIG. 12 , but the mode switching unit and the pointer executioninstruction unit may be separated from each other.

In case the mode switching unit or the pointer execution instructionunit is provided outside down the text input region, the pointerlocation information input region needs to be set in an area excludingthe area in which the mode switching unit or the pointer executioninstruction unit is provided, so as to prevent the location informationinput devices 1421 and 1422 from erroneously operating with amisdetection that a user inputs pointer location information, when theuser puts his/her finger on the mode switching unit or the pointerexecution instruction unit so as to control the mode switching unit orthe pointer execution instruction unit.

To this end, an area covered by an optical signal generated from apointer location information input device may be adjusted such that theoptical signal cannot arrive the mode switching unit or the pointerexecution instruction unit

optical signal receiving angle of a camera may be adjusted, or thecamera may be set to ignore an optical signal received in acorresponding direction such that the camera cannot receive the opticalsignal generated by a reflection, an interference, or blocking betweenthe optical signal and user's finger positioned on the mode switchingunit or the pointer execution instruction unit.

The portable notebook may be designed to have, on at least three edgesthereof, an absorber plate or a reflector plate for absorbing orreflecting a light generated from the pointer location information inputdevice.

In this case, the reflectors or the absorbers may be disposed at twoedges of the respective side surfaces of the human interface device(1423 and 1424), and disposed in a predetermined region 1412 at the restof the three edges where the display unit contacts the human interfacedevice such that the light generated by the pointer location informationinput devices 1421 and 1422 can be fully reflected or absorbed when thedisplay unit is opened within a predetermined angle.

FIG. 9 illustrates an exemplary embodiment adopting a bottom-locatedpointer location information input device and a bottom-located pointerexecution instruction unit.

A human interface device may include a text input unit 1501 formed of aplurality of physical buttons; a pointer location information input unitfor receiving, from a user, information related to a pointer location; apointer execution instruction receiving unit for receiving signals ofpointer execution instruction units 1505 and 1506 for receiving userinstruction so as to perform at least one function at the pointerlocation; a mode switching instruction receiving unit for receiving asignal of a mode switching unit for switching to a pointer locationinformation input mode; and a pointer location information transmittingunit for transmitting the information related to the pointer location,input to the pointer location information input unit, to a digitaldevice connected to the human interface device in a wired or wirelessmanner, wherein the pointer location information input unit may have apointer location information input region disposed to be parallel to atop of at least a part of a text input region of the text input unitformed of a plurality of physical buttons, and the pointer locationinformation input unit may include, at first to third surfaces thereof1502 a, 1502 b and 1502 c enclosing the text input unit, optical signalreflectors or absorbers 1503 a, 1503 b and 1503 c formed higher than aheight of the text input unit, and a fourth surface 1502 d enclosing thetext input unit is formed lower than height of the first to thirdsurfaces, and the fourth surface 1502 d may include the pointerexecution instruction units 1505 and 1506. The first and third surfacesmay be disposed respectively at left and right sides of the text inputunit, the second surface may be disposed on the text input unit, and thefourth surface may be disposed beneath the text input unit.

The pointer location information input unit may include at least twosensor modules, and the two sensor modules may be disposed respectivelyat edges of left and right lower ends of the text input unit.

The mode switching unit may operate by a first user input inputted to afirst button, and the pointer execution instruction receiving unit mayoperate by a second user input inputted to the first button.

The first button may be made of a material capable of sensing anelectrical signal generated by a finger touch, and the first input maybe generated by detecting the electrical signal.

The mode switching unit may operate in the pointer location informationinput mode during maintenance of the first input, and cancel the pointerlocation information input mode when the first input is cancelled, andthe first input may be generated by physical pressure.

The mode switching unit may operate by a second user input inputted to asecond button, and, when the second input is inputted one time, activatethe pointer location information input mode if the pointer locationinformation input mode is cancelled, and cancel the pointer locationinformation input mode if the pointer location information input mode isactivated.

In this case, it may be preferable that light generated by the pointerlocation information input devices 1421 and 1422, and an image receivingdevice are directed toward a center of a keyboard.

When the keyboard is small, or to ensure a wider pointer locationinformation input region, the reflector plate rather than the absorberplate among the reflector plate or the reflector plate 1423 and 1424positioned at a side surface of the human interface device may be used,and the light generated by the pointer location information inputdevices 1421 and 1422, and the image receiving device may be directedtoward the reflector plate 1423 and 1424.

That is, the pointer location information input device 1421 may receivepointer location information reflected by the reflector plate 1423.

The pointer location information input device 1422 may receive pointerlocation information reflected by the reflector plate 1424.

Thus, an effect of enabling the pointer location information inputdevices 1421 and 1422 to be located in left and right outsides of anactual multi-functional human interface device can be obtained,providing a wider mouse pointer location information input region.

In this case, the reflector plate 1423 and 1424 may be provided to havean angle opened at a predetermined angle of 1 to 15 degrees. That is,the reflector plate 1423 and 1424 may be arranged such that a bottomthereof opens wider than a top thereof.

Thus, an effect of enabling the pointer location information inputdevices 1421 and 1422 to be located in left and right outsides of anactual multi-functional human interface device can be obtained, and aneffect of enabling the pointer location information input devices 1421and 1422 to move upwardly by a predetermined distance so as not to beinterfered with the pointer execution instruction input device locatedat a bottom of the keyboard can be obtained.

The multi-functional human interface device may include reflection unitsfor reflecting light generated from the pointer location informationinput units, at least two pointer location information input units maybe provided respectively at left and right sides of the human interfacedevice, the reflection units may be provided respectively at left andright sides of the human interface device, and the left pointer locationinformation input unit may be directed toward the left reflection unitso as to receive light input through the left reflection unit, and theright pointer location information input unit may be directed toward theright reflection unit so as to receive light input through the rightreflection unit.

The left and right reflection units may not be parallel to each otherand may be opened toward areas in which the left and right pointerlocation information input units are disposed.

The pointer location information input region may be divided into afirst region and a second region. That is, a pointer locationinformation input signal from a right hand may be received from thefirst region, and a pointer location information input signal from aleft hand may be received from the second region.

In general, a multi-touch control may receive a plurality of touch inputsignals, and determine a control command according to an aspect offurther movement of the plurality of touch input signals.

However, in the present exemplary embodiment, a first pointer locationinformation input signal received from the first pointer locationinformation input region may be used in identifying the number of touchinputs.

Furthermore, a second pointer location information input signal receivedfrom the second pointer location information input region may be used inreceiving a touch input movement signal.

That is, for example, when a vertical sliding touch is input by usingone right finger with left two fingers kept on touch inputting, thesignal generated from this operation can be replaced by two touchsignals having a general multi-touch function, used in a vertical touchinput. In general, performing vertical scrolling on Internet browser maybe an example of performing a vertical sliding touch input by twotouches in Macbook of Apple Inc. In this case, when one right fingertaps, the left hand performs two touch inputs, and thus the performancewould be the same as tapping with two fingers.

For another example, when a horizontal sliding touch is input by usingthe right hand with left three fingers kept on touch inputting, thesignal generated from this operation can be replaced by three touchsignals having a general multi-touch function, used in a horizontalsliding touch input. In general, performing functions such as swipe on awhole screen application or dragging by three fingers may be an exampleof performing a horizontal sliding touch input by three touches inMacbook of Apple Inc.

In this case, when one right finger taps, the left hand performs threetouch inputs, and thus the performance would be the same as those oftapping with three fingers. The example of the left hand and right handmay be replaced by the example of the right hand and left hand, and thenumber of input signals for determining the number of touches is notlimited to two or three described above, but includes one, four, or fivetouches.

The information related to the pointer location received by the pointerlocation information input unit may include information related to afirst pointer location for moving the pointer location, and informationrelated to a second pointer location for switching from a text inputmode to a pointer location information input mode in the human interfacedevice.

For example, when a pointer location information input signal higherthan a preset threshold level is generated in a text input mode, themode may be switched to a pointer location information input mode.

FIG. 10 is an exploded perspective view illustrating a multi-functionalinput button.

The multi-functional input button may form the text input deviceintegrated with a pointing device 310 in a human interface such as akeyboard, including: a text input unit 303 for inputting at least onetext; and a physical touch pad 311 such as a capacitive pad for moving amouse pointer or inputting pointing location information for inputting auser touch or 3D gesture on a screen.

The present exemplary embodiment describes a capacitive touch methoduseful in a pointing location information input unit, but the modeswitching unit, the pointer execution instruction input unit, specialfunction keys, locations of the mode switching unit and the pointerexecution instruction unit, the connection to the inner or outer displayunit, the battery embedding method using the cover unit, the function ofadjusting the angle of the human interface device, the text inputregion, the mouse pointing location information input region, and thelike of the multi-functional human interface device described above byusing the pointing location information input unit adopting an opticalmethod can be applied the same to the present exemplary embodiment.

The text input device integrated with a pointing device 310 may beformed of a plurality of multi-functional input buttons.

The multi-functional input button may include a cover unit 1010 on whichuser's finger touch is performed; an electrode unit 1020 including atransmitter and a receiver for generating an electrical field; and abase unit 1030 for protecting the electrode unit and ensuringconnectivity to an elastic unit.

The elastic unit may include an elastic body 1050, an upper support unit1040, and a lower support unit 1060.

The upper support unit and the lower support unit may be formed into acylindrical or polygonal body shape, and may move location thereofthrough the elastic body, and the lower support unit may guide themovement of the upper support unit.

The upper support unit may be fixed to the cover unit, the electrodeunit, and the base unit.

The lower support unit may serve as a guide for a reciprocation of theupper support unit.

The upper support unit and the lower support unit may have a pantographstructure, interconnect an upper structure including the electrode unitand a lower structure including the elastic unit, and guide the movementof the upper structure.

The elastic body may be a dome-shaped elastic material having restoringforce, a plate-shaped elastic material having restoring force, aspring-shaped elastic material, a plurality of magnets having differentpolarities facing each other, and a combination thereof.

The elastic unit may receive second pressure from the cover unit so asto move to a third height, and return to a first height when the secondpressure of the second cover unit is cancelled. Moving to the thirdheight may mean a physical movement, bending of an object by pressure,or sensing the second pressure by software and the like.

A pointer execution instruction may be generated upon sensing of thefirst pressure, and an additional pointer execution instruction may begenerated upon sensing of the second pressure.

For example, an application execution instruction may be displayed at apointer location by the first pressure, and an additional option, apreview and the like of the application may be performed by the secondpressure.

An electrical signal indicating an input of a predetermined charactergenerated through the switch of the first to fifth multi-functionalinput buttons may indicate an input of different characters, and acontact location of the user finger or a change in the contact locationdetermined from the signal received through the electrode unit of thefirst to fifth multi-functional input buttons may intend to successivelycontrol the locations of one pointer.

The human interface device may further include a mode switching unit forswitching between a text input mode and a pointing location informationinput mode.

The mode switching unit may operate by the multi-functional inputbutton, a separate physical switch unit, a touch switch unit, or apredetermined touch pattern.

The human interface device may generate pointing location informationfor controlling successively one pointing input device on a characterinput device formed of a plurality of combinations of multi-functionalinput buttons capable of inputting one character and an electrode of theplurality of multi-functional input buttons.

The human interface device may include the mode switching unit and thepointer execution instruction unit separately from the plurality ofmulti-functional input buttons.

The mode switching unit and the pointer execution instruction unit maybe one button formed of an electrode capable of recognizing a user touchand a switch, and may generate a pointer execution instruction by apressure signal without the need of moving or taking off fingers aftermode switching by a touch.

The multi-functional input buttons may include a light emitting unit1070.

The light emitting unit 1070 may light characters indicating characterinput on the multi-functional input buttons, or may light locations ofthe multi-functional input buttons.

The light emitting unit may be disposed on the upper structure includingthe electrode unit, or a lower structure including the elastic body.

The upper structure may include the electrode unit, move by pressurefrom a user, and include the cover unit, the electrode unit, the baseunit and the like.

The lower structure may be a part including a structure, which guidesthe movement of the upper structure and transmits or receives anelectrical signal from the electrode unit, and not moving when pressureis applied from a user.

FIG. 11 illustrates an exemplary embodiment of an electrode of amulti-functional input button.

An electrode unit adopting a capacitive touch method may include aplurality of transmitters and receivers.

A general electrode unit adopting a capacitive touch method may have asquare shape in which transmitters in 5 to 30 rows and receivers in 5 to30 columns are arranged in a grid.

The multi-functional input buttons of the present exemplary embodimentmay be formed of an electrode unit having a size same as that of onecharacter input button having a width of 10 to 20 mm.

The electrode unit may form an independent small touch pad to be used asa pointing location information input device, and may cooperate with aplurality of multi-functional input buttons so as to be used as aconnective pointing location information input device in a wider region.

The electrode unit may include one to three transmitters and receivers.

The electrode unit of one of the multi-functional input buttons of thepresent exemplary embodiment will be described by way of example of amulti-functional input button including three columns of transmittershaving different driver signal periods and two rows of receivers havingdifferent scan periods.

Here, a period may refer to a timing for generating a signal.

In the present inventive concept, the number and shape of transmittersand receivers may be readily modified by a person skilled in the artaccording to the size and shape of the button.

The electrode unit may include first transmitters 1101, 1102 and 1103having a first drive period, second transmitters 1104, 1105 and 1106having a second drive period, and third transmitters 1107, 1108 and 1109having a third drive period.

The electrode unit may include first receivers 1110 and 1111 having afirst scan period, and second receivers 1112 and 1113 having a secondscan period.

The first to third transmitters may be short-circuited from each otheror connected into a single unit without a separate connection member ona circuit board.

The first and second receivers may be short-circuited from each otherand printed on a circuit board and connected by a separate connectionmember, or may be arranged to be independently scanned with anelectrical signal such as capacity during a scan period.

The electrode unit of the present exemplary embodiment may require aspecial design such that a plurality of electrode units of a pluralityof multi-functional input buttons can be recognized as a singlelarge-area electrode unit and each of the multi-functional input buttonscan move upwards and downwards.

For example, the second transmitters may have a width wider than the sumof widths of the first and third transmitters.

The sum of widths of the first to third transmitters may be smaller thanthe sum of widths of the first and second receivers.

Receivers having one scan period may be interconnected in a generalcapacitive touch pad. In the present exemplary embodiment, the firstreceiver having one scan period may include at least two receiver blocks1110 and 1111, and the at least two receiver blocks 1110 and 1111 may beshort-circuited from each other and transmit a scan signal to anoutside.

The scan signal may be processed by summing capacitive signals receivedfrom the respective receiver blocks.

Although, in the present exemplary embodiment, the transmitters arearranged in a column and the receivers are arranged in a row, thetransmitters may be arranged in a row and the receiver may be arrangedin a column in the same structure.

The transmitters and the receivers may be electrically short-circuitedby insulators 1114 and 1115.

The electrode unit may include a bridge 1120 stacked or connected belowso as to transmit and receive an external driver signal and a scansignal.

The bridge may transmit a driver signal to the electrode unit, andreceive a capacitive signal from the receiver.

FIG. 12 illustrates an exemplary embodiment of an arrangement ofmulti-functional input buttons.

The multi-functional human interface device of the present exemplaryembodiment may include at least five multi-functional input buttons.

A second multi-functional input button 1220 and a third multi-functionalinput button 1230 may be disposed respective at a left side and a rightside of a first multi-functional input button 1210, a central point ofthe second multi-functional input button may be arranged on a virtualX-axis line extending leftward and rightward from a central point of thefirst multi-functional input button, and a central point of the thirdmulti-functional input button may be arranged on a virtual X-axis lineextending rightward from a central point of the first multi-functionalinput button.

The multi-functional human interface device may further include a fourthmulti-functional input button 1240 and a fifth multi-functional inputbutton 1250, and a central point of the forth multi-functional inputbutton 1240 may be arranged at a left side from a virtual Y-axisextending upward from the central point of the first multi-functionalinput button and at a right side from a virtual Y-axis extending upwardfrom the central point of the second multi-functional input button, anda central point of the fifth multi-functional input button 1250 may bearranged at a right side from a virtual Y-axis extending downward fromthe central point of the first multi-functional input button and at aleft side from a virtual Y-axis extending downward from the centralpoint of the third multi-functional input button, and the fourth andfifth multi-functional input buttons may be disposed adjacent to thefirst multi-functional input button.

The distance by which the central point of the fourth multi-functionalinput button 1240 is spaced leftward apart from the virtual Y-axisextending upward from the central point of the first multi-functionalinput button 1210 may be shorter than the distance by which the centralpoint of the fifth multi-functional input button 1250 is spacedrightward apart from the virtual Y-axis extending downward from thecentral point of the first multi-functional input button 1210.

For example, the fifth multi-functional input button 1250 may bedisposed at the location spaced rightward apart from the Y-axis by 40 to60 percent of the width of the first multi-functional input button 1210.

The fourth multi-functional input button 1240 may be disposed at thelocation spaced leftward apart from the Y-axis as much as 15 to 35percent of the width of the first multi-functional input button 1210.

The first transmitter of the first to third multi-functional inputbuttons may have a driver signal period same as that of the thirdtransmitter of the fourth multi-functional input button 1240.

The second receiver of the first multi-functional input button 1210 mayhave a scan period same as that of the first receiver of the fifthmulti-functional input button 1250.

The first receiver of the first multi-functional input button 1210 andthe second receiver of the fifth multi-functional input button 1250 mayhave scan periods different from each other.

The second receiver of the first multi-functional input button 1210 andthe second receiver of the fourth multi-functional input button 1240 maynot be disposed in a row in the virtual Y-axis direction but may bemoved leftward within the width of the first multi-functional inputbutton 1210, and the second receiver of the first multi-functional inputbutton 1210 and the second receiver of the fourth multi-functional inputbutton 1240 may have the same scan period.

Consequently, pointing location information signal distortions mayoccur, which requires a step of correcting by software.

The human interface device may further include a sixth multi-functionalinput button 1260 having a central point disposed on a virtual Y-axisextending downward from the central point of the fifth multi-functionalinput button 1250.

FIG. 13 illustrates an exemplary embodiment of an arrangement ofelectrodes of multi-functional input buttons having different patterns.

The first multi-functional input button 1210 and the fourthmulti-functional input button 1240 may not be disposed in a row on avirtual Y-axis but may be moved leftward as much as a first distance.

Thus, signal distortions may occur in the receivers of the firstmulti-functional input button 1210 and the fourth multi-functional inputbutton 1240.

To prevent or minimize signal distortions, the fourth multi-functionalinput button 1240 may have a modified pattern.

For example, an electrode 1130 shown in FIG. 11 may have a pattern movedfrom a left side toward a right side of the electrode 1130 as much asthe first distance so as to form a second electrode shape 1350.

The second electrode shape may provide an effect of aligning, on thevirtual Y-axis, receivers of the first multi-functional input button andfourth multi-functional input button.

A seventh multi-functional input button 1360 having the second electrodeshape may be disposed at a right side of the fourth multi-functionalinput button.

In this case, a receiver 1351 disposed at a rightmost side of the fourthmulti-functional input button may have a scan period same as that of areceiver 1361 disposed at a leftmost side of the seventhmulti-functional input button 1360. In this case, the second receivers1112 and 1113 of the first multi-functional input button may also havethe same scan period.

FIG. 14 illustrates exemplary embodiments of an electrical connectionmember of a multi-functional input button.

The transmitters of the first to third multi-functional input buttonsmay be interconnected by a first electrical connection member, and thereceivers of the first, fourth, and fifth multi-functional input buttonsmay be interconnected by a second electrical connection member.

The connection member of a first exemplary embodiment may include afirst conductor contacting or joining the electrode unit and movingtogether with the electrode unit while a multi-functional input buttonis moving from a first height to a second height by pressure applied tothe multi-functional input button; a second conductor provided in anon-moving part of the multi-functional input button so as to receive anelectrical signal from the first conductor; and a base PCB connected tothe second conductor of an adjacent multi-functional input button.

The base PCB may transmit/receive driver signals or scan signals from acontrol unit to/from transmitters or receivers of a plurality ofmulti-functional input buttons.

The first conductor and the second conductor may move while maintainingcontact and connection therebetween in a mutual sliding manner.

The first conductor and the second conductor may be kept contacting eachother when no pressure is applied to the multi-functional input buttonor pressure equal to or lower than a predetermined threshold level isapplied to the multi-functional input button, and the first conductorand the second conductor may be kept contacting each other andshort-circuited from each other when pressure equal to or higher thanthe predetermined threshold level is applied to the multi-functionalinput button.

The first conductor and the second conductor may be arranged in anon-contact manner (1450). The first conductor and the second conductormay be formed into a conductive plate shape having a predetermined area,and contact each other with predetermine spacing therebetween.

The predetermined spacing may be filled with a non-conductor 1443 havingdielectricity such as air, plastic, silicon, glass, ceramic and thelike.

In this case, the electrical signal may be transmitted in the form of aradio signal having a frequency.

Thus, an abrasion of the conductors caused by friction between the firstconductor and the second conductor, or signal noise may be reduced, andfriction which may interfere with pressure being applied to themulti-functional input button may be minimized, and manufacturingprocesses may be simplified.

At least either the first electrical connection member or secondelectrical connection member may be printed together with the electrodeunit on a flexible film as a conductor, or may be an electricalconnection member provided to the elastic unit contacting or joining theelectrode unit.

FIG. 15 illustrates an exemplary embodiment of a switch of amulti-functional input button for inputting characters.

When the multi-functional input button moves from a first location to asecond location by pressure applied thereto, switches 1511, 1512 and1513 may operate so as to generate an electrical signal indicating aninput of a predetermined character.

When the switches 1512 and 1523 provided on the base PCB or a separatemembrane are connected by the terminal 1511 provided on a moving unit ofthe multi-functional input button, an electrical signal indicating aninput of a predetermined character may be generated and transmitted tothe control unit.

The switches may generate electrical signals by sensing a separate pressswitch, an amount of change in magnetism or electrical field, lightintensity, sound, and the like.

FIG. 16 illustrates an exemplary embodiment of a human interface devicehaving a multi-functional input button.

FIG. 17 illustrates an exemplary embodiment of an electrode key cap.

A plurality of electrode key caps 1700 may be disposed on a common planeso as to form an electrode key cap layer 1620.

For example, one electrode key cap may receive one character input andsense a predetermined amount of changes in a touch location according toa mode.

The electrode key cap layer may receive a plurality of character inputs,and sense an amount of changes in a touch location in proportion to thenumber of electrode key caps.

The multi-functional human interface device may include: a control unit;the cover unit 1010 on which user's finger touch is performed; theelectrode key cap 1700 including first conductors 1741, 1742, 1713,1714, 1746 and 1748 and electrode units 1020 and 1701; and a secondconductor.

The second conductor may be provided in a first circuit layer 1630.

A user's finger touch on the cover unit tightly contacting a top of theelectrode key cap may give an influence to an electrical field betweenthe transmitter and receiver in the electrode, causing changes incapacity.

The first conductor may be plural in number, and provided respectivelyin the transmitter and receiver of the electrode unit.

When a driver signal is applied on a predetermined period through thefirst conductor connected to the transmitter, capacity may be generatedbetween the transmitter and the receiver, and the generated capacity maybe transmitted by the receiver through the first conductor connected tothe receiver and through the second conductor electrically connected tothe first conductor, and the control unit may sense changes in thetransmitted capacity.

The electrode unit may be electrically connected to the second conductorthrough the first conductor, and the electrode unit may be disposed on afirst surface 1702 of the electrode key cap, and the first conductor maybe formed into a predetermined area on a column formed perpendicularlyto the first surface.

The column formed perpendicularly to the first surface may be at leasttwo in number, and the first conductor may be formed respectively on theat least two columns.

The electrode units 1020 and 1701 may include a transmitter and areceiver, and the first conductor formed respectively on the at leasttwo columns may be electrically connected to the respective transmitterand receiver.

The first conductor may be formed to encircle the surface of the column.

The column may be formed into a tubular shape having a hole 1703penetrating through the column, and the hole 1703 may penetrate throughthe first surface 1702 such that the electrode unit and the firstconductor may be electrically connected through an inner wall of thehole 1703.

The electrode unit may have a plurality of pattern blocks 1701 having aspecific shape on the first surface, and at least a part of the patternblocks 1701 may be electrically interconnected through a second surface1731 of the electrode key cap.

The plurality of pattern blocks 1704 electrically connected through thesecond surface may be electrically connected to the second conductorthrough the first conductor 1713 formed on one of the columns.

For example, the three top triangular pattern blocks on the firstsurface 1702 may be electrically connected by the conductor provided onthe side surface 1731 adjacent to the three top triangular patternblocks.

The three bottom triangular pattern blocks, in the same manner, may beelectrically connected by the conductor provided on the side surfaceadjacent to the three bottom triangular pattern blocks.

In this case, the three top or bottom triangular pattern blocks may beelectrically connected to one column provided at rear surfaces of thepattern blocks through a hole formed in the column.

Furthermore, triangular and diamond-shaped pattern blocks formedhorizontally in an intermediate part may be electrically connected atthe first surface, and electrically connected to one column provided atrear surfaces of the pattern blocks and the first conductor through ahole formed in the column in the same manner, and the column used hereinmay be located at a center of the rear surfaces and may also be used forthe purpose of transferring pressure to the elastic unit.

In this case, the top, bottom, and the intermediate pattern blocks maytransmit transmitter signals having different signal periods.

Furthermore, the two upper diamond-shaped pattern blocks disposedhorizontally and the two lower diamond-shaped pattern blocks disposedhorizontally may be electrically isolated on the first surface, andrespectively electrically connected to the first conductor through holesformed in the respective columns provided at rear surfaces of thepattern blocks.

The first conductor may be provided respectively to the plurality ofcolumns at a rear surface of the electrode key cap.

The plurality of pattern blocks electrically connected through thesecond surface may be transmitters having the same signal period.

The electrode unit may have at least three pattern blocks 1704 having aspecific shape on the first surface, and the three pattern blocks may berespectively electrically connected to the second conductor through thefirst conductor formed on one of columns.

At least two pattern blocks among the plurality of pattern blocks mayhave a first signal period, and at least one pattern block among theplurality of pattern blocks may have a second signal period.

The at least three pattern blocks may be receivers.

The multi-functional human interface device may further include theelastic body 1050, and the column may transfer, to the elastic unit,pressure applied from a user to the cover unit, and enable the coverunit and the electrode key cap to move from a first location to a secondlocation, and receive the pressure from the elastic unit when thepressure from the user is cancelled so as to enable the cover unit andthe electrode key cap to move from the second location to the firstlocation.

The electrode unit and the first conductor may be formed by plating,with a conductive material, an insulator structure including at leastone flat plate, and at least two columns connected perpendicularly tothe flat plate and having holes penetrating through the flat plate andthe columns.

The electrode unit may have a plurality of pattern blocks having aspecific shape on the first surface, and a plurality of columns formedon a third surface 1710 disposed on at the rear of the first surface.

The first conductors may be formed on the plurality of columns, and thefirst conductors formed on the plurality of columns may be electricallyshort-circuited by the third surface.

The electrode unit may have a plurality of pattern blocks having aspecific shape on the first surface, and the plurality of pattern blocksmay be electrically connected to the fourth surface 1732 disposed at oneside of the first surface, but electrically short-circuited from eachother by an electrical short-circuit 1733 formed on the fourth surface1732.

The pattern blocks may not be limited to those illustrated in thedrawings, and may include various patterns such as a rectangular patternand a comb teeth pattern.

The multi-functional human interface device may include a plurality ofelectrode key caps, and the first conductors provided to the pluralityof electrode key caps may transmit electrical signals to the pluralityof second conductors, and the plurality of second conductors may formone first circuit layer 1630.

The multi-functional human interface device may further include a lightsource beneath the electrode key cap, and the column may have a tubularshape having a hole penetrating the column, and the cover unit may bemade of a conductive plate material for diffusing light and receivelight from the light source through the hole so as to emit the light.

The hole may be necessarily used so as to electrically connect theelectrode unit and the first conductor of the electrode key cap in aplating manner.

However, the plating may make the electrode key cap opaque, and thus itmay be difficult to provide a keyboard with a function of emitting lightto allow for ease of work in a dark place.

The light may be transmitted through the hole, and thus the hole may beused as an electrical connection path and a light path.

The cover unit may have a user contact surface printed or carved with acharacter for guiding text input, or a film perforated with the shape ofthe character may be attached to the cover unit.

The first conductor and the second conductor may respectivepredetermined areas facing each other in a non-contact manner, and anelectrical signal of a high frequency may be transmitted through thepredetermined area in a non-contact manner.

For example, if the column has a cylindrical shape, the surface of thecolumn facing the first conductor and the second conductor in anon-contact manner may have a band shape with a predetermined width, andif the column is a square column, the surface may have a square bandshape with a predetermined width. Alternatively, only a part of thecolumn may be provided with the first conductor so as to form a facingsurface having a desired shape and area.

FIG. 18 to FIG. 22 illustrate an exemplary embodiment of electrodepatterns of a plurality of multi-functional input buttons.

The multi-functional human interface device may be used in a variety ofelectronic devices such as an input device for a desk top, an inputdevice for a table PC, an input device for a notebook, an input devicefor controlling a home theater, an input device for controllingmultimedia of an automatic driving vehicle, and an input device for VRor AR.

The electronic device having the multi-functional human interface devicemay include first to fifth multi-functional input buttons.

The first to fifth multi-functional input buttons may respectivelyreceive different character inputs, and receive touch inputs forcontrolling one piece of pointer location information from a user.

The first to fifth multi-functional input buttons may be provided on anX-axis or Y-axis without being aligned in a line.

For example, the first to third multi-functional input buttons may bealigned in a line in an X-axis direction, and the fourth and fifthmulti-function input buttons may be disposed above and below the X-axis.

Furthermore, the fourth multi-functional input button 1240 may not bealigned with the first multi-functional input button with respect to aY-axis, but may be 25 percent spaced apart leftward.

The fifth multi-functional input button 1250 may not be aligned with thefirst multi-functional input button with respect to a Y-axis, but may be50 percent spaced apart rightward.

The transmitters having the same driver signal may be aligned in a lineand the receivers having the same scan signal period may be aligned in aline, among the plurality of transmitters and the plurality ofreceivers, so as to enable the first to fifth multi-functional inputbuttons to control one piece of pointer location information.

Since the first to fifth multi-functional input buttons are not alignedin a line with respect to an X-axis or Y-axis, the multi-functionalinput buttons may have two to four receivers or transmitter parallel toan X-axis or Y-axis such that the receivers or transmitters can bealigned even though the multi-functional input buttons are not alignedin a line with respect to an X-axis or Y-axis.

Each of the multi-functional input buttons may include electrode units1020 a, 1020 b, 1020 c, 1020 d, 1020 e, 1020 f, 1020 g, 1020 h, 1020 i,1020 j, 1020 k and 1020 l formed of transmitter units T1, T2, T3 and T4and receiver units R1, R2, R3 and R4.

The transmitter units of the electrode units may be arranged in parallelto an X-axis, and the receiver units of the electrode units may bearranged in parallel to a Y-axis (1020 a, 1020 c, 1020 e, 1020 g, 1020i, and 1020 k).

In the exemplary embodiments to be described hereinafter, the electrodeunit will be described as having transmitters parallel to an X-axis andreceivers parallel to a Y-axis, but the configuration in which thetransmitters and receivers are switched with each other may also bepossible, that is, the receivers may be arranged in parallel to anX-axis and the transmitters may be arranged in parallel to a Y-axis.

The electrode units may have transmitters parallel to a Y-axis andreceivers transmitters parallel to an X-axis (1020 b, 1020 d, 1020 f,1020 h, 1020 j, and 1020 l).

FIG. 18 illustrates an exemplary embodiment of electrode patterns of aplurality of multi-functional input buttons, in which the electrode unitmay include four transmitters and four receivers.

Although, in the exemplary embodiments to be described hereinafter, theelectrode unit will be described as having four transmitters parallel toan X-axis and four receivers 1020 a parallel to a Y-axis, theconfiguration in which four receivers are arranged in parallel to anX-axis and four transmitters 1020 b are arranged in parallel to a Y-axismay also be possible.

The transmitter unit may have first to fourth transmitters having atleast two driver signal periods, and the receiver unit may have first tofourth receivers R1, R2, R3, and R4 having at least two scan signalperiods different from each other.

The first receiver of the fourth multi-functional input button 1240 mayhave a scan signal period same as that of the fourth receiver of thesecond multi-functional input button 1220.

The second receiver of the fourth multi-functional input button 1240 mayhave a scan signal period same as that of the first receiver of thefirst multi-functional input button 1210.

The third receiver of the fourth multi-functional input button 1240 mayhave a scan signal period same as that of the second receiver of thefirst multi-functional input button 1210.

The fourth receiver of the fourth multi-functional input button 1240 mayhave a scan signal period same as those of the third receiver of thefirst multi-functional input button 1210 and the first receiver of thefifth multi-functional input button 1250.

The electronic device having the multi-functional human interface devicemay have the sixth multi-functional input button 1260, and the sixthmulti-functional input button 1260 may be aligned adjacent to the fifthmulti-functional input button 1250 on a Y-axis, and the first to fourthreceivers of the sixth multi-functional input button 1260 may have ascan signal period same as those of the first to fourth receivers of thefifth multi-functional input button 1250.

On the contrary, the fifth multi-functional input button 1250 and thesixth multi-functional input button 1260 may have driver signal periodsdifferent from each other.

The electronic device having the multi-functional human interface devicemay have a seventh multi-functional input button 1270.

The first receiver of the seventh multi-functional input button 1270 mayhave a scan signal period same as those of the fourth receiver of thefirst multi-functional input button 1210 and the second receiver of thefifth multi-functional input button 1250.

The second receiver of the seventh multi-functional input button 1270may have a scan signal period same as those of the first receiver of thethird multi-functional input button 1230 and the third receiver of thefifth multi-functional input button 1250.

The first transmitters of the first to third multi-functional inputbuttons may have a first driver period, and the second transmitters ofthe first to third multi-functional input buttons may have a seconddriver period.

The first transmitters of the fourth and seventh multi-functional inputbuttons may have a third driver period, and the second transmitters ofthe fourth and seventh multi-functional input buttons may have a fourthdriver period.

The first transmitter of the fifth multi-functional input button mayhave a fifth driver period, and the second transmitter of the fifthmulti-functional input button may have a six driver period.

The first transmitter of the sixth multi-functional input button mayhave a seventh driver period, and the second transmitter of the sixthmulti-functional input button may have an eighth driver period.

At least two of the first to fifth multi-functional input buttons mayrespectively have the first and second receivers having the same scansignal period, and the third and fourth receivers having the same scansignal period.

At least two of the first to fifth multi-functional input buttons mayrespectively have the second and third receivers having the same scansignal period, and the first and fourth receivers having scan signalperiods different from each other.

For example, the first multi-functional input button may have the firstand second receivers having a first scan signal period, and the thirdand fourth receivers having a second scan signal period.

The third multi-functional input button may have the first and secondreceivers having a third scan signal period, and the third and fourthreceivers having a fourth scan signal period.

The fourth multi-functional input button may have the first receiverhaving a fifth scan signal period, and the second and third receivershaving the first scan signal period, and the fourth receiver having thesecond scan signal period.

The seventh multi-functional input button may have the first receiverhaving the second scan signal period, and the second and third receivershaving the third scan signal period, and the fourth receiver having thefourth scan signal period.

FIG. 19 illustrates an exemplary embodiment of electrode patterns of aplurality of multi-functional input buttons, in which the electrode unitmay include two transmitters parallel to an X-axis and four receivers1020 c parallel to a Y-axis.

Although, in the exemplary embodiments to be described hereinafter, theelectrode unit will be described as having two transmitters parallel toan X-axis and four receivers 1020 c parallel to a Y-axis, theconfiguration in which two receivers are arranged in parallel to anX-axis and four transmitters 1020 d are arranged in parallel to a Y-axismay also be possible.

The electronic device having the multi-functional human interface devicemay include first to fifth multi-functional input buttons, and each ofthe multi-functional input buttons may have an electrode unit formed ofa transmitter unit and a receiver unit.

The transmitter unit may have first and second transmitters havingdriver signal periods different from each other, and the receiver unitmay have first and second receivers having scan signal periods differentfrom each other.

The second receiver of the first multi-functional input button may havea scan signal period same as that of the first receiver of the fifthmulti-functional input button, and the first receiver of the thirdmulti-functional input button may have a scan signal period same as thatof the second receiver of the fifth multi-functional input button.

The first transmitters of the first to third multi-functional inputbuttons may have a first driver signal period, the second transmittersof the first to third multi-functional input buttons may have a seconddriver signal period, the first transmitter of the fourthmulti-functional input button may have a third driver signal period, thesecond transmitter of the fourth multi-functional input button may havea fourth driver signal period, the first transmitter of the fifthmulti-functional input button may have a fifth driver signal period, andthe second transmitter of the fifth multi-functional input button mayhave a sixth driver signal period.

The central points of the first to third multi-functional input buttonsmay be disposed on a virtual X-axis, the first and second transmittersof the first to fifth multi-functional input buttons may besubstantially parallel to the virtual X-axis, and the first receiver andthe second receiver of the first to fifth multi-functional input buttonsmay be substantially perpendicular to the virtual X-axis.

The second receiver of the first multi-functional input button, thefirst receiver of the fifth multi-functional input button, and thesecond receiver of the fourth multi-functional input button may have thesame scan signal period.

Alternatively, the second receiver of the first multi-functional inputbutton, the first receiver of the fifth multi-functional input button,and the first receiver of the seventh multi-functional input button mayhave the same scan signal period.

The second receiver of the first multi-functional input button and thefirst receiver of the fifth multi-functional input button may be alignedin a line perpendicular to the X-axis, and the second receiver of thefourth multi-functional input button and the first receiver of theseventh multi-functional input button may be spaced apart from eachother by a first distance 2010.

This may be required for simplifying patterns so as to reducemanufacturing cost of multi-functional input buttons. In this case, asoftware correction in a user touch input may be required.

The first and fourth multi-functional input buttons may have a controlunit for correcting coordinates of a user touch input in an X-axisdirection in correspondence to the first distance when user touch iscontinuously input perpendicularly to the X-axis from the firstmulti-functional input button to the fourth multi-functional inputbutton.

The first to fifth multi-functional input buttons may include a controlunit for sensing user touch continuously input from a region includingsurfaces of the first to fifth multi-functional input buttons, andcontinuously controlling one pointer location.

The first to fifth multi-functional input buttons may includerespectively a control unit for sensing a user pressure signal andgenerating first to fifth character input signals.

That is, the plurality of multi-functional input buttons may generaterespective characters corresponding to the respective keys of akeyboard, and simultaneously generate pointer location information suchas one mouse pointer by a continuous user touch input generated acrossbuttons in a touch surface region of the adjacent plurality ofmulti-functional input buttons, and control the movement of the pointerlocation.

When a plurality of touches are simultaneously performed in the touchsurface region of the adjacent plurality of multi-functional inputbuttons, a multi-touch function such as zoom in, zoom out, scrolling,and screen switching may be performed.

As for the electrode unit 1020 h in which the receivers are parallel toan X-axis and the transmitters are parallel to a Y-axis, an electronicdevice having the multi-functional human interface device may includefirst to fifth multi-functional input buttons, and the respectivemulti-functional input buttons may include an electrode unit including atransmitter unit and a receiver unit, and the transmitter unit mayinclude first and second transmitters having driver signal periodsdifferent from each other, and the receiver unit may include first andsecond receivers having scan signal periods different from each other.

The second transmitter of the first multi-functional input button mayhave a driver signal period same as that of the first transmitter of thefifth multi-functional input button, and the first transmitter of thethird multi-functional input button may have a driver signal period sameas that of the second transmitter of the fifth multi-functional inputbutton.

The first receivers of the first to third multi-functional input buttonsmay have a first scan signal period, the second receivers of the firstto third multi-functional input buttons may have a second scan signalperiod, the first receiver of the fourth multi-functional input buttonmay have a third scan signal period, the second receiver of the fourthmulti-functional input button may have a fourth scan signal period, thefirst receiver of the fifth multi-functional input button may have afifth scan signal period, and the second receiver of the fifthmulti-functional input button may have a sixth scan signal period.

The central point of the first to third multi-functional input buttonsmay be disposed on a virtual X-axis, the first and second receivers ofthe first to fifth multi-functional input buttons may be substantiallyparallel to the virtual X-axis, and the first and second transmitters ofthe first to fifth multi-functional input buttons may be substantiallyperpendicular to the virtual X-axis.

The second transmitter of the first multi-functional input button andthe first transmitter of the fifth multi-functional input button may bealigned in a line perpendicular to the X-axis, and may be interposedbetween the second transmitter of the fourth multi-functional inputbutton and the first transmitter of the seventh multi-functional inputbutton.

FIG. 23 is a flowchart illustrating a method for switching between atext input mode and a pointer location information input mode.

The electronic device having a multi-functional human interface devicemay have a right-handed mode and a left-handed mode.

The right-handed mode may set a touch region such that a user touch canbe easily input to the touch region from a right hand of a user.

The left-handed mode may set a touch region such that a user touch canbe easily input to the touch region from a left hand of a user.

The right-handed mode and the left-handed mode may be set on theelectronic device having a multi-functional human interface device by aseparate switch, at least two simultaneous text inputs, a predeterminedtouch pattern, a combination of a text input and a touch input, an inputthrough a mode switching unit, and the like.

The electronic device having a multi-functional human interface devicemay include a first pointer execution instruction button and a secondpointer execution instruction button operating by pressure applied froma user, and the first pointer execution instruction button and thesecond pointer execution instruction button may further include a sensorfor sensing a user touch input, and the electronic device having amulti-functional human interface device may be switched to a temporarytouch mode when a touch input is received to the first pointer executioninstruction button and the second pointer execution instruction button.

The temporary touch mode may be cancelled and switched to a text inputmode when the user touch is cancelled from the first pointer executioninstruction button or the second pointer execution instruction button.

The first pointer execution instruction button may be disposed at a leftside of the second pointer execution instruction button and adjacent toa left thumb of the user, and the second pointer execution instructionbutton may be disposed adjacent to a right thumb of the user.

When the electronic device having a multi-function human interfacedevice is switched to the temporary touch mode through the touch sensorprovided in the first pointer execution instruction button, theelectronic device having a multi-functional human interface device maybe switched to the right-handed mode.

The right-handed mode may set a right hand touch region 108 b forreceiving pointer location information such that a touch input by aright hand can be easily performed.

The right hand touch region 108 b may be set to cover an area excludinga region on which a user's left hand finger is put to input text.

For example, a general keyboard-type multi-functional human interfacemay have layouts in which a left side from a Y-axis including characterF key is set as an inactive touch region and a right side from a Y-axisincluding character G key is set as an active touch region.

When the electronic device having a multi-function human interfacedevice is switched to the temporary touch mode through the touch sensorprovided in the second pointer execution instruction button, theelectronic device having a multi-functional human interface device maybe switched to the left-handed mode.

The left-handed mode may set a left hand touch region 108 a forreceiving pointer location information such that a touch input by a lefthand can be easily performed.

The left hand touch region 108 a may be set to cover an area excluding aregion on which a user's right hand finger is put to input text.

For example, a general keyboard-type multi-functional human interfacemay have layouts in which a right side from a Y-axis including characterJ key is set as an inactive touch region and a left side from a Y-axisincluding character H key is set as an active touch region.

Furthermore, an external device connected to the electronic devicehaving a multi-functional human interface device may have a preset leftor right mode.

The temporary touch mode may be switched to the right hand touch modewhen, in US international keyboard layouts, user touch inputs aregenerated simultaneously from at least two among a plurality ofmulti-functional input buttons for generating input signals ofcharacters Q W, E, and R, and the right hand touch mode is cancelled andswitched to a text input mode when the at least two user touch inputsare cancelled.

The temporary touch mode may be switched to the right hand touch modewhen, in US international keyboard layouts, user touch inputs aregenerated simultaneously from at least two among a plurality ofmulti-functional input buttons for generating input signals ofcharacters Z, X, C, and V, and the right hand touch mode is cancelledand switched to a text input mode when the at least two user touchinputs are cancelled.

The temporary touch mode may be switched to the left hand touch modewhen, in US international keyboard layouts, user touch inputs aregenerated simultaneously from at least two among a plurality ofmulti-functional input buttons for generating input signals ofcharacters U, I, O, and P, and the left hand touch mode is cancelled andswitched to a text input mode when the at least two user touch inputsare cancelled.

The temporary touch mode may be switched to the left hand touch modewhen, in US international keyboard layouts, user touch inputs aregenerated simultaneously from at least two among a plurality ofmulti-functional input buttons for generating input signals ofcharacters M, <, >, and ?, and the left hand touch mode is cancelled andswitched to a text input mode when the at least two user touch inputsare cancelled.

The multi-functional input buttons in which at least two touch inputsmay occur simultaneously, may function as a first pointer executioninstruction input or a second pointer execution instruction input of thepointer being controlled during execution of the temporary touch mode,when a pressure signal is further received during maintenance of thetouch inputs.

The text input mode may be inactivated when the temporary touch mode isactivated.

When the text input mode is inactivated, an exception may be made inwhich at least one text input is allowed.

FIG. 24 is a flowchart illustrating a method for switching to apermanent touch mode.

When the first pointer execution instruction button and the secondpointer execution instruction button are pressed simultaneously for apreset time, the electronic device having a multi-functional humaninterface device may be set to a permanent touch mode.

The electronic device having a multi-functional human interface devicemay be set to a permanent touch mode by a separate switch, at least twosimultaneous text inputs, a predetermined touch pattern, a combinationof a text input and a touch input, an operation of a mode switchingunit, and the like.

The permanent touch mode may receive a pointer location informationinput from a user without the need to maintain a separate user input forthe pointer location information input.

For example, in the temporary touch mode, the electronic device having amulti-functional human interface device may be basically set to a textinput mode, and switched to the temporary touch mode during maintenanceof a separate user input, and the temporary touch mode may be cancelledand switched to the text input mode when the separate user input iscancelled.

In the permanent touch mode, the electronic device having amulti-functional human interface device may be basically set to thepermanent touch mode, and the text input mode may be in activated.

The permanent touch mode may be cancelled under a preset condition.

For example, the permanent touch mode may be cancelled when there is nouser input for a preset time in the set permanent touch mode.

The permanent touch mode may be cancelled when a predefined touchpattern, a predetermined button, a text input button in which theexception of inactivation is made, repeated text, and a plurality ofpieces of text are simultaneously input in the set permanent touch mode.

The permanent touch mode may include at least a part of a touch regionin the right hand touch mode and at least a part of a touch region inthe left hand touch mode, and may have a region wider than the touchregion in the right hand touch mode and the touch region in the lefthand touch mode.

Preferably, the region of the permanent touch mode may be the sum of thetouch region in the right hand touch mode and the touch region in theleft hand touch mode.

FIG. 25 illustrates a multi-functional input button module having aplurality of multi-functional input buttons provided in the shape of aplate.

The module having a plurality of multi-functional input buttons producedin the shape of a plate may be used as a multi-keyboard module used in anotebook, a portable keyboard, a desktop keyboard, or an Internet TVinput device.

The module may include a plurality of cover units 1010, a plurality ofelectrode units 1020, an electrical connection member 2610, a pluralityof base units 1030, a balance maintenance unit 2620 configured to assistthe cover units 1010 in vertically moving in parallel, and a pluralityof elastic units 1050 in sequence.

FIG. 26 illustrates an example of a detailed structure of the electrodeunit 1020.

Each of the plurality of electrode units 1020 may be produced by atransmitter unit and a receiver unit being printed (1020 b) withconductive inks on a film 1020 a cut to fit the size of the cover units1010 or produced in the form of a flexible printed circuit board (FPCB).

The electrical connection member 2610 may be produced in the form of anFPCB and may have contact points with at least one transmitter and atleast one receiver of the electrode unit.

The electrical connection member 2610 and the electrode unit 1020 areattached to each other by using a conductive adhesive 2611 to allowelectricity to flow through the contact points.

The electrical connection member 2610 may be integrated with theelectrode unit 1020 in the form of an FPCB.

FIG. 27 illustrates an example of an adhesion portion of a conductiveadhesive.

The conductive adhesive may be used to attach a portion of theelectrical connection member to a portion of the electrode unit.

In this case, a part 2712 other than the adhesion portion may be formedas a structure 2711 that is connected with an electrical connectionmember of an adjacent multi-functional input button and capable of beingflexibly moved as the cover unit is moved

member capable of being flexibly moved may be formed in the shape of anuppercase letter L and may be formed in the shape of an uppercase letterU along with an adjacent electrical connection member.

Such a shape shows optimal performance in maintaining a conduction statewhile minimizing physical resistance to a user even when positions ofthe electrical connection member and the adjacent multi-functional inputbutton change vertically as the cover unit vertically moves.

The electrical connection member may be used to connect the plurality ofelectrode units to each other and may be connected with circuit layersplaced on a first surface and a second surface.

A circuit layer 2613 placed on the first surface may generate a driversignal to be delivered to transmitters of the first to fifthmulti-functional input buttons, and a circuit layer 2612 placed on thesecond surface may receive a scan signal from receivers of the first tofifth multi-functional input buttons.

The circuit layer may be connected with a control unit to generate adriver signal and receive a scan signal.

FIG. 28 illustrates an exemplary embodiment of a multi-functional inputbutton.

FIG. 28 includes a development view 2810 of the multi-functional inputbutton, an assembly view 2820 of the multi-functional input button, asectional view 2830 of the multi-functional input button, and asectional view 2840 of the multi-functional input button when the coverunit is moved.

The multi-functional input button may include a cover unit 2811, anelectrode unit 2818, a first base unit 2812, a balance maintenance unit2813, an elastic unit 1050, a first circuit layer 2816, a second circuitlayer 2815, a third circuit layer 2814, a second base unit 2803, and anelectrical connection member 2819.

The multi-functional input button may further include a light emittingunit 2817, and the light emitting unit 2817 may be placed on theelectrode unit or the circuit layer.

The electrode unit, the electrical connection member, and the circuitlayer may be produced in the form of a single FPCB.

The first circuit layer 2816 may receive both of a pointer locationinformation input signal and a text input signal.

The elastic unit may be adhered to the circuit layer. Thus, it ispossible to remove an unnecessary layer and reduce a thickness thereof.

The cover unit and the base unit may have bonding members 2820 and 2821so that the cover unit and the base unit are bonded to each other.

Alternatively, the cover unit and the base unit may have a column and ahole 2801, respectively, so that the cover unit and the base unit arebonded to each other.

The electrode unit may be inserted between the cover unit and the baseunit and may be connected with the circuit layer through the electricalconnection member.

The circuit layer may be adhered to the second base unit.

The circuit layer may be connected with an electrical connection memberof a single multi-functional input button and may be connected to thecontrol unit through a separate circuit layer.

The circuit layer may be connected with electrical connection members ofthe plurality of multi-functional input buttons and thus may beconnected to the control unit.

The width 2832 of the electrode unit may be greater than the width 2831of the circuit layer. Thus, it is possible to minimize movement of theelectrical connection member and minimize physical resistance to theuser when the cover unit is moved.

The electrical connection member 2819 may be formed of flexible materialto change in shape when the cover unit moves.

The electrical connection member 2819 may change in shape while movingto a position 2843 lower than that of the second base unit when thecover unit moves.

FIG. 29 illustrates an exemplary embodiment of a wireless electricalconnection member.

FIG. 29 shows a portion 2930 of the multi-functional input button otherthan the elastic unit and the balance maintenance unit of themulti-functional input button.

The multi-functional input button may include a cover unit 2902, anelectrode unit 2901, first electrical connection members 2903 and 2904,second electrical connection members 2933 and 2934, a base unit 2932,and a circuit layer 2931.

The first electrical connection members 2903 and 2904 may include anelectrical connection member 2903 connected with a transmitter and anelectrical connection member 2904 connected with a receiver.

The second electrical connection members 2933 and 2934 may include anelectrical connection member 2933 corresponding to the electricalconnection member 2903 connected with the transmitter and an electricalconnection member 2934 corresponding to the electrical connection member2904 connected with the receiver.

The first electrical connection members and the second electricalconnection members may deliver electrical signals to each other in awired manner while the first electrical connection members and thesecond electrical connection members are not physically attached to eachother.

The first electrical connection members and the second electricalconnection members may deliver electrical signals to each other in awired manner by using high frequency signals.

The first electrical connection members and the second electricalconnection members may deliver electrical signals to each other in awired manner by using an electrostatic induction method.

The first electrical connection members and the second electricalconnection members may be formed by at least one of a method 2940 for acoil having several turns, a spiral method 2950, and a method 2860 ofwinding around an insulator.

An electronic device having a multi-functional human interface mayinclude first to fifth multi-functional input buttons and a circuitlayer configured to deliver a signal received from the input buttons toa control unit. Each of the multi-functional input buttons may includean electrode unit composed of a transmitter unit and a receiver unit andconfigured to receive a touch input from the user, an electricalconnection member connected with the electrode unit, and a switchconfigured to generate a text input signal in response to physicalpressure from the user. The transmitter unit may have first and secondtransmitters having different driver signal occurrence timings. Thereceiver unit may have at least two first and second receivers havingdifferent scan timings. The electrical connection member may beelectrically connected with the electrode unit and the circuit layereven when relative positions of the electrode unit and the circuit layerare changed due to the physical pressure from the user.

The first receiver of the fourth multi-functional input button may havethe same scan timing as the second receiver of the secondmulti-functional input button, and the second receiver of the fourthmulti-functional input button may have the same scan timing as the firstreceiver of the first multi-functional input button.

The first transmitters of the first to third multi-functional inputbuttons may have a first driver signal occurrence timing. The secondtransmitters of the first to third multi-functional input buttons mayhave a second driver signal occurrence timing. The first driver signaloccurrence timing may be different from the second driver signaloccurrence timing.

The second transmitter of the fourth multi-functional input button mayhave a third driver signal occurrence timing. The first transmitter ofthe fifth multi-functional input button may have a fourth driver signaloccurrence timing. The third driver signal occurrence timing, the firstdriver signal occurrence timing, the second driver signal occurrencetiming, and the fourth driver signal occurrence timing may be insequence.

The first receiver of the fifth multi-functional input button may havethe same scan timing as the second receiver of the firstmulti-functional input button, and the second receiver of the fifthmulti-functional input button may have the same scan timing as the firstreceiver of the third multi-functional input button.

A multi-functional human interface having the circuit layer, theelectrode unit of the first multi-functional input button, and theelectrical connection member of the first multi-functional input buttonformed as a single FPCB may be provided.

A multi-functional human interface having the electrode units of thefirst to fifth multi-functional input buttons, the electrical connectionmembers of the first to fifth multi-functional input buttons, and thecircuit layer formed as a single FPCB may be provided.

The electrical connection member may have a first lead connected withthe electrode unit and a second lead connected with the circuit layer,and the first lead and the second lead may change in relative positionbut maintain electrical connection therebetween when a pressure signalis applied by the user.

The electrical connection member may have a first lead connected withthe electrode unit and a second lead connected with the circuit layer,and the first lead and the second lead may change in relative positionwhen a pressure signal is applied by the user and may be separated acertain distance or more from each other to transmit electrical signalsby using an electromagnetic induction phenomenon.

The electrical connection member may have a first lead connected withthe electrode unit and a second lead connected with the circuit layer,and the first lead and the second lead may change in relative positionwhen a pressure signal is applied by the user and may be separated acertain distance or more from each other to transmit electrical signalsby using high frequency signals.

The electrical connection member may be formed of an elastic material toelectrically connect the electrode unit with the circuit layer. When theelectrode unit is moved by a pressure signal from the user, a force mayoccur in a direction opposite to the pressure signal from the user. Whenthe pressure signal from the user is removed, the electrode unit may bereturned to a position before the movement.

The first receiver of the fourth multi-functional input button may havethe same scan timing as the first receiver of the first multi-functionalinput button, and the second receiver of the fourth multi-functionalinput button may have the same scan timing as the second receiver of thefirst multi-functional input button and the first receiver of the fifthmulti-functional input button.

The first transmitter of the fourth multi-functional input button mayhave the same driver signal occurrence timing as the first transmitterof the first multi-functional input button, and the second transmitterof the fourth multi-functional input button may have the same driversignal occurrence timing as the second transmitter of the firstmulti-functional input button and the first transmitter of the fifthmulti-functional input button.

The first receivers of the first to third multi-functional input buttonsmay have a first scan timing. The second receivers of the first to thirdmulti-functional input buttons may have a second scan timing. The firstscan timing may be different from the second scan timing.

The second receiver of the fourth multi-functional input button may havea third scan timing. The first receiver of the fifth multi-functionalinput button may have a fourth scan timing. The third scan timing, thefirst scan timing, the second scan timing, and the fourth scan timingmay be in sequence.

The first transmitter of the fourth multi-functional input button mayhave the same driver signal occurrence timing as the second transmitterof the second multi-functional input button, and the second transmitterof the fourth multi-functional input button may have the same driversignal occurrence timing as the first transmitter of the firstmulti-functional input button.

The first transmitter of the third multi-functional input button mayhave the same driver signal occurrence timing as the second transmitterof the fifth multi-functional input button.

The multi-functional input button may further include a first controlunit, and the first control unit may process a touch signal and a textinput signal that are received from the multi-functional input buttonand may transmit the processed touch signal and text input signal to asecond control unit.

The circuit layer may include a driver signal generation unit configuredto deliver a driver signal to the transmitters of the first to fifthmulti-functional input buttons and a scan signal reception unitconfigured to receive a scan signal from the receivers of the first tofifth multi-functional input buttons.

The first to fifth multi-functional input buttons may include aplurality of electrical connection members. The first multi-functionalinput button may be connected with the electrical connection members ofthe second to fifth multi-functional input buttons. The secondmulti-functional input button may be connected with the electricalconnection members of the first and fourth multi-functional inputbuttons. The third multi-functional input button may be connected withthe electrical connection member of the first multi-functional inputbutton. The fourth multi-functional input button may be connected withthe electrical connection members of the first and secondmulti-functional input buttons. The fifth multi-functional input buttonmay be connected with the electrical connection members of the first andthird multi-functional input buttons.

FIGS. 1 to 29 illustrate an exemplary embodiment of a text input deviceintegrated with a pointing device as the electronic device having amulti-functional human interface device, and the types of the text inputdevice and the pointing location information input device and techniquesused herein may be changed or replaced by a person skilled in the artwithout departing from basic purposes.

FIG. 30 is an example of a block diagram of a pointing-device-integratedtext input device 3000.

Referring to FIG. 30 , the pointing-device-integrated text input device3000 according to an embodiment of the present invention may include abutton 3100 configured to receive a push input or a touch input from auser, a switch 3200 configured to acquire a key value when the button isdepressed according to the push input, an electric connection member3300 configured to form a circuit 3400 acquired by a change incapacitance of an electrode 3130 included in the button 3100 accordingto the touch input, and a controller 3500 configured to process varioustypes of information and electric signals in addition to calculation ofa touch coordinate value based on the change in capacitance.

Here, the push input, which is a user input in which physical pressureis applied to the button 3100, refers to a user input for inducing thebutton 3100 to be depressed by a predetermined distance or more andenabling the button 3100 to induce the switch 3200 to output a key valueallocated to the switch 3200 when the button 3100 comes into contactwith the switch 3200 or pushes the switch 3200. In this description, thepush input may be mainly used as a user input for text input when thepointing-device-integrated text input device 3000 is utilized as akeyboard interface.

Also, the touch input, which is a user input in which the button 3100 istouched, refers to a user input for inducing a change in capacitance ofthe electrode 3130 built into the button 3100. In this case, when thechange in capacitance is a predetermined touch threshold value or more,the capacitance change may be understood as being the touch input. Inthis description, the touch input may be mainly used as a user input forcontrolling a position of a pointer P when thepointing-device-integrated text input device 3000 is utilized as a mouseinterface or a digitizer interface.

The pointing-device-integrated text input device 3000 may be provided inan overall form of a keyboard, similarly to that shown in FIG. 9 , ormay be provided in the form of a notebook combined with a display and akeyboard, as shown in FIG. 8 .

A plurality of buttons 3100 that are arranged according to apredetermined keyboard layout may be included in thepointing-device-integrated text input device 3000. Here, the button 3100may correspond to the multi-functional input button that has beendescribed with reference to FIG. 10, 14, 25, 28 , and the like.

The button 3100 may include a keycap 3110, a button body 3120, and anelectrode 3130. Here, the keycap 3110 and the button body 3120 may bedisposed on an upper portion and a lower portion of the button 3100,respectively, and the electrode 3130 may be interposed between thekeycap 3110 and the button body 3120. That is, the button 3100 may beprovided by sequentially stacking and combining the keycap 3110, theelectrode 3130, and the button body 3120.

The keycap 3110 may be disposed on a top surface of the button 3100,that is, an exposed surface on the keyboard layout. The keycap 3110 maycome into direct contact with a user's finger. That is, the user mayperform a push input for typing by pressing the keycap 3110, or mayperform a touch input for pointer control (e.g., movement of a mousecursor) by touching the keycap 3110. For convenience of typing, acharacter or the like allocated to the button may be printed on thekeycap 3110.

The button body 3120 may be disposed under the keycap 3110. The buttonbody 3120 may be moved vertically, that is, be moved upward anddownward, when the push input is vertically applied thereto through thekeycap 3110. When the button body 3120 is moved downward, the buttonbody 3120 may physically push the switch 3200 or may come intoelectrical contact with the switch 3200. As will be described below, theswitch 3200 may acquire a key value allocated to the button 3100 throughsuch an operation.

The electrode 3130 is interposed between the keycap 3110 and the buttonbody 3120. When a touch input is applied to the keycap 3110, thecapacitance of the electrode 3130 changes such that the electrode 3130may sense the touch input.

The electrode 3130 may be composed of a plurality of blocks 3130′. Someof the blocks 3130′ may form a first block group 3131 in which theblocks are electrically connected in a first direction, which is any oneof a length direction and a width direction of the keyboard layout. Theother of the blocks 3130′ may form a second block group 3132 in whichthe blocks are electrically connected in a second direction, which isdifferent from the first direction and is the other one of the lengthdirection and the width direction of the keyboard layout. Here, thefirst block group 3131 and the second block group 3132 beingelectrically connected should be interpreted as including a case inwhich the blocks 3130′ forming the block groups 3131 and 3132 aredirectly physically and electrically connected and also a case in whichthe blocks 3130′ are indirectly physically connected through anelectrical connection means such as electric wires or conductors.

In detail, the electrode 3130 may be provided in a similar way to theelectrode unit 1130 shown in FIG. 11 .

Here, like the electrode unit 1130, the electrode 3130 may be composedof a plurality of blocks 1101, 1102, 1103, 1104, 1105, 1106, 1107, 1108,1109, 1110, 1111, 1112, and 1113. Here, some of the blocks may beelectrically connected in a horizontal direction or a vertical directionto form a block group. For example, a block group of FIG. 11 in whichblocks are horizontally connected (e.g., a block group formed by threeblocks 1101, 1102, and 1103, a block group formed by three other blocks1104, 1105, and 1106, and a block group formed by three other blocks1107, 1108, and 1109) may be one of the first block group 3131 and thesecond block group 3132. Also, a block group of FIG. 11 in which blocksare vertically connected (e.g., a block group formed by two blocks 1110and 1111 and a block group formed by two other blocks 1112 and 1113) maybe the other one of the first block group 3131 and the second blockgroup 3132.

The keycap 3110 may corresponding to the above-described cover unit, thebutton body 3120 may corresponding to the above-described base unit orupper support unit, and the electrode 3130 may correspond to theabove-described electrode unit. For example, the keycap 3110 may be oneof the cover units that have been described with reference to FIGS. 10,14, 25, and 28 . For example, the button body 3120 may be one of thebase unit 1030 and 2932 and the upper support unit 1040 that have beendescribed with reference to FIGS. 10, 14, 25, and 28 . For example, theelectrode 3130 may be the electrode unit 1020 that has been describedwith reference to FIGS. 10, 14, 25, and 28 .

Moreover, a structure of the button 3100 has been sufficiently describedwith reference to FIGS. 10, 14, 25, and 28 , and thus a detaileddescription thereof will be omitted. Likewise, a form of the electrode3130 has been sufficiently described with reference to FIGS. 11 to 13and 18 to 22 , and a detailed description thereof will also be omitted.

The switch 3200 is located under the button 3100. For example, theswitch 3200 may be disposed under the button 3100 such that a pluralityof switches 3200 correspond to the plurality of buttons 3100 on asubstrate located under a button layer in which the buttons 3100 arearranged according to the keyboard layout.

When the button 3100 is moved downward according to a vertical pushinput of the user, the switch 3200 may be brought into contact with thebutton 3100 or may be pressed by the button 3100. Thus, the switch 3200may acquire or output a key value corresponding to the button 3100.

A detailed structure of the switch 3200 has been described withreference to FIGS. 4, 10, and 28 , and thus a detailed descriptionthereof will be omitted.

The electric connection member 3300 may connect the block groups 3131and 3132 between the plurality of buttons 3100 to form the circuit 3400.Here, the electric connection member 3300 may be provided in the form ofpins such as first conductors 1080 and 1441 attached to the uppersupport unit 1040 and second conductors 1090 and 1442 attached to thelower support units 1050 and 1060, as shown in FIG. 10 or 14 . Inaddition, the electric connection member 3300 may be provided in theforms shown in FIGS. 10, 14, 27, and 29 . In summary, a representativeaspect of the electric connection member 3300 may be implemented as apattern printed on a FPCB or may be formed as conductors installed onthe substrate at which the switch is installed and at the button 3100that is moved upward.

The electric connection member 3300 may establish electrical connectionsbetween blocks 3030′ that are not directly physically connected on thesurface of the electrode 3130 among a plurality of blocks 3030′ of anelectrode 3130 belonging to a single button 3100.

Also, by connecting block groups 3131 and 3132 formed at an electrode3130 of each of a plurality of adjacent buttons 3100, the electricconnection member 3300 may consecutively connect the block groups 3131and 132 for the plurality of buttons 3100.

For example, the electric connection member 3300 may form a drive lineby consecutively connecting first block groups 3131 of an electrode 3130belonging to a plurality of buttons 3100 arranged in the firstdirection, which is any one of the length direction and the widthdirection of the keyboard layout. As another example, the electricconnection member 3300 may form a scan line by consecutively connectingsecond block groups 3132 of an electrode 3130 belonging to a pluralityof buttons 3100 arranged in the second direction, which is the other oneof the length direction and the width direction of the keyboard layout.

Here, the first block group 3131 arranged on the drive line maycorrespond to the above-described transmitter, and the second blockgroup 3132 arranged on the scan line may correspond to theabove-described receiver.

A drive signal is applied to the drive line. The drive signal may beapplied to the first block groups 3131 located on the drive line by theelectric connection member 3300 to induce capacitance in the electrode3130. Also, a scan signal, which reflects that the capacitance inducedfor the electrode 3130 by the drive signal is changed due to a touchinput of the user, may be processed in the scan line. The scan signalmay be a signal for detecting a change in capacitance in the secondblock groups 3132 located on the scan line by the electric connectionmember 3300.

A configuration of the drive line and the scan line and processing ofthe drive signal and the scan signal have been described above in detailwith reference to FIGS. 11 to 13 and 18 to 22 , and thus a detaileddescription will be omitted.

The controller 3500 may be implemented as a central processing unit(CPU) or the like in hardware, software, or a combination thereof. Inhardware, the controller 3500 may be provided in the form of anelectronic circuit that process electrical signals to perform a controlfunction. In software, the controller 3500 may be provided in the formof a program, an application, or firmware that is processed by thehardware controller 3500.

The controller 3500 may process electronic signals or information andperform calculations. Thus, the controller 3500 may process an overalloperation of the pointing-device-integrated text input device 3000 ormay control each element of the pointing-device-integrated text inputdevice 3000. For example, the controller 3500 may acquire a scan signalfrom the scan line and calculate a touch coordinate value on the basisof the scan signal. As another example, the controller 3500 may performa mode switching operation of the pointing-device-integrated text inputdevice 3000.

In addition, the controller 3500 may process and perform various kindsof functions or operations of the pointing-device-integrated text inputdevice 3000. This will be described below in detail. In thisdescription, the functions or operation of thepointing-device-integrated text input device 3000 may be interpreted asbeing performed under control of the controller 3500 unless speciallystated otherwise.

FIG. 31 is an example in which the pointing-device-integrated text inputdevice 3000 of FIG. 30 performs signal processing on a text input.

Referring to FIG. 31 , according to the pointing-device-integrated textinput device 3000, when a predetermined button 3100 receives a pushinput from a user, the button 3100 is moved downward and comes intocontact with or presses a switch 3200 matched to the button 3100, andthus the switch 3200 generates an electric signal. The generatedelectric signal may include identification information (i.e., a keyidentifier) of the switch 3200. The controller 3500 receives theelectric signal and outputs a key value corresponding to the button 3100that received the push input as a keyboard input on the basis of thereceived electric signal.

Here, the key value, which is reflected or included in the keyboardinput, may be a character value. However, the key value is not always acharacter value. For example, buttons 3100 corresponding to functionkeys (F1 to F12 keys, an END key, a SHIFT key, a Print Screen key, anESC key, direction keys, etc.) may have function values as key valuesinstead of character values. However, in this description, there is nobenefit in distinguishing between the key value and the character valuein most cases, and thus the key value and the character value areconsidered to conceptually correspond to each other when necessary.

The key value and the key identifier have different concepts. Forexample, two or more keys may be set for one button 3100. For example, alowercase “a” may be allocated to a button to which an uppercase “A” isallocated. In this case, even when the same key identifier is receivedfrom the switch 3200, the controller 3500 may select one of “A” and “a”as a key value depending on whether the point-device-integrated textinput device 3000 is in an uppercase input mode or a lowercase inputmode.

FIG. 32 is an example in which the pointing-device-integrated text inputdevice 3000 of FIG. 30 performs signal processing on a mouse input.

Referring to FIG. 32 , the pointing-device-integrated text input device3000 may apply and/or receive a drive signal and a scan signal to and/orfrom the electrode 3130. The drive signal and the scan signal may beoutput by the controller 3500 and then transmitted to and/or receivedfrom the first block group 3131 and the second block group 3132 throughthe drive line and the scan line formed by the electric connectionmember 3300, respectively. Capacitance induced by the drive signal inthe electrode 3130 may change due to a touch input of a user, and thecontroller 3500 receives a scan signal that reflects the amount ofchange.

The controller 3500 may calculate a touch coordinate value inconsideration of a drive signal period, a scan signal period, and achange in capacitance reflected by a scan signal for each scan signalperiod in a plurality of drive lines and a plurality of scan lines, andmay acquire and output touch information including the calculated touchcoordinate value. Typically, the touch coordinate value may have a formof (x, y) including an x coordinate value corresponding to a lateraldirection on a display and a y coordinate value corresponding to alongitudinal direction on the display. Also, the controller 3500 mayacquire touch information including time information as well as thetouch coordinate value. The touch information may have a form of (x, y,t) further including a touch input time t of the touch input that causedthe touch coordinate value. However, in this description, there is nobenefit in distinguishing between the touch coordinate value and thetouch information in most cases, and thus the touch coordinate value andthe touch information should be interpreted as being interchangeablyused unless specially stated otherwise.

The controller 3500 may acquire a mouse input on the basis of the touchcoordinate value (or the touch information) and output the acquiredmouse input. Here, the mouse input may be slightly different from thetouch coordinate value. Typically, the mouse input may have a form of(x′, y′) or (x′, y′, t). A difference between the mouse input and thetouch coordinate value will be described in detail below.

Here, the mouse input may refer to an input that is mainly output by amouse interface to control the position of the pointer P displayed onthe display. For example, an electronic device such as a personalcomputer (PC), a notebook, a smartphone, a tablet, or the like may use amouse input to control the position of the pointer P displayed on thedisplay. The controller 3500 of the pointing-device-integrated textinput device 3000 may generate a mouse input on the basis of the touchcoordinate value or the touch information, and transmit the generatedmouse input to the electronic device. When the mouse input is received,the electronic device may move the position of the pointer P displayedon the display according to the mouse input by means of an operatingsystem or a mouse driver interface.

It should be appreciated that, when the pointing-device-integrated textinput device 3000 is embedded in the electronic device as shown in FIG.8 , the controller 3500 may move the position of the pointer P accordingto an autonomously generated mouse input or may deliver a mouse input toa separate operation unit for processing an operating system or a mousedriver interface so that the operation unit can control the position ofthe pointer P.

The aforementioned mouse input may be generated through the followingprocess.

When a user enters a touch input in a touch region 3010 formed on thepointing-device-integrated text input device 3000, the controller 3500may receive a scan signal reflecting a change in capacitance detected bythe electrode 3130 in real time from a scan line and may calculate atouch coordinate value on the basis of the scan signal. Here, the touchregion 3010, which is a region formed on the pointing-device-integraltext input device 1000, refers to a region in which the controller 3500may detect the user's touch input and calculate a touch coordinate valuethereof. Generally, the touch region 3010 may be formed on buttons 3100having an electrode 3130 among a plurality of buttons 3100.

Next, the controller 3500 may calculate a touch coordinate variation onthe basis of the touch coordinate value. Here, the touch coordinatevalue may correspond to the above-described form (x, y), and the touchcoordinate variation may correspond to a form (x′, y′). In detail, thecontroller 3500 may calculate the touch coordinate variation through adifference operation of a current touch coordinate value and a previoustouch coordinate value. In this case, the current touch coordinate valuemay be a touch coordinate value calculated using a scan signal acquiredover a current scan signal period, and the previous touch coordinatevalue may be a touch coordinate value calculated using a scan signalacquired over a scan signal period directly before the current scansignal period.

Here, the touch coordinate variation may refer to a “relative coordinatevalue” because the touch coordinate variation is a difference betweenthe current touch coordinate value and the previous touch coordinatevalue.

The controller 3500 may acquire the touch coordinate variation as amouse input and output the mouse input. An electronic device, a separateinternal operation unit, or the controller 3500 that acquires the mouseinput may move the pointer P on the display or control the position ofthe pointer P according to the mouse input.

Unlike the above description, instead of acquiring a touch coordinatevariation as a mouse input and outputting the acquired touch coordinatevariation, the controller 3500 may deliver touch information and alsoidentification information indicating that the touch information is amouse input to an electronic device or a separate internal operationunit, and may induce the electronic device or the internal operationunit to autonomously generate a mouse input and perform position controlon the pointer P.

FIGS. 33 and 34 are an example of an operation of the pointer Pcorresponding to the mouse input of FIG. 32 .

Referring to FIG. 33 , a user may enter a touch input for dragging thepointer P from a first location L1 to a second location L2 in the touchregion 3010. The controller 3500 may calculate a touch coordinate valuecorresponding to the touch input in real time, acquire a touchcoordinate variation through a difference operation of the calculatedcoordinate value, and output the touch coordinate variation as a mouseinput.

Referring to FIG. 34 , the pointer P being displayed on the screen 10may be processed by such a mouse input to move along a pathcorresponding to a drag path. As a result, the pointer P may be movedfrom a first point D1 on the screen 10 corresponding to the firstlocation L1 in the touch region 3010 to a second point D2 correspondingto the second location L2.

FIGS. 35 and 36 are another example of an operation of the pointer Pcorresponding to the mouse input of FIG. 32 .

Referring to FIG. 35 , a user may enter a touch input in which the firstlocation L1 in the touch region 3010 is touched and then enter a touchinput in which the second location L2 is touched without any other touchinput. For example, this is a case in which the user touches the firstlocation L1, lifts his or her finger, and then touches the secondlocation L2. When two such touch inputs are generated, the controller3500 does not generate a touch coordinate variation because the twotouch inputs have an interval of a predetermined time period or more,and thus a continuous difference in touch coordinate value does notoccur. That is, the controller may calculate “0” as the relativecoordinate value, which is the mouse input.

Accordingly, referring to FIG. 36 , the pointer P displayed on thescreen 10 may be processed by the mouse input so as not to move from athird point D3 at which the pointer P is displayed on the screen 10 whenthe first location L1 is touched.

FIG. 37 is an example of digitizer input signal processing of thepointing-device-integrated text input device 3000 of FIG. 30 .

Touch information to be described with reference to FIG. 37 may beprocessed as a digitizer input that is slightly different from the mouseinput.

The mouse input has a form of a sensing point difference value that isgenerated while a mouse moves or a touch moves on a touch screen, thatis, a form of a relative coordinate value. The mouse input is used tomove the position of the pointer P. The digitizer input is an inputhaving a form in which the touch region 3010 corresponds to thedisplayed screen 10. That is, the digitizer input has touch coordinatevalues of touch regions 3010 corresponding to specific points on thescreen 10. Typically, the digitizer input has advantages in creatingdrawings, designs, or design drawings because the touch region 3010itself is matched to the screen 10. Accordingly, conventional digitizerinterfaces are frequently used in various industrial areas or art anddesign areas in place of a mouse.

In this description, the controller 3500 of thepointing-device-integrated text input device 3000 may generate adigitizer input on the basis of the touch coordinate value or the touchinformation and transmit the digitizer input to an electronic devicesuch as a PC, a notebook, a smartphone, or a tablet that controls theposition of the pointer P according to the digitizer input. When thedigitizer input is received, the electronic device may move the positionof the pointer P displayed on the display according to the digitizerinput by means of an operating system or a digitizer driver interface.It should be appreciated that, when the pointing-device-integrated textinput device 3000 is embedded in the electronic device as shown in FIG.8 , the controller 3500 may control the position of the pointer Paccording to an autonomously generated digitizer input or may deliver adigitizer input to a separate operation unit for processing an operatingsystem or a digitizer driver interface so that the operation unit cancontrol the position of the pointer P.

The aforementioned digitizer input may be generated through thefollowing process.

When a user enters a touch input in a touch region 3010 formed on thepointing-device-integrated text input device 3000, the controller 3500may receive a scan signal reflecting a change in capacitance detected bythe electrode 3130 from a scan line and may calculate a touch coordinatevalue on the basis of the scan signal.

Next, the controller 3500 may calculate a point value of the screen 10corresponding to the touch coordinate value in consideration of arelationship between the touch region and a resolution of the screen 10,acquire the point value as a digitizer input, and output the digitizerinput. Here, the point value of the screen 10 may be a resolutioncoordinate value of the screen 10.

An electronic device, an operation unit, or the controller 3500 thatacquires the digitizer input may control the position of the pointer Pon the display according to the digitizer input. In detail, the positionof the pointer P is set as the point value of the screen 10.

Here, the digitizer input may refer to an “absolute coordinate value”because the touch coordinates in the touch region 10 is matched to thepoints in the screen 10 on the display.

Unlike the above description, instead of converting a touch coordinatevalue into a point value on the screen 10 in consideration of theresolution of the screen 10 to acquire a point value as a digitizerinput, the controller 3500 may output the touch coordinate value itselfas the digitizer input and may induce the electronic device or theoperation unit to autonomously calculate the point value (a resolutionvalue) and control the position of the pointer P.

FIG. 38 is an example of an operation of the pointer P corresponding tothe digitizer input of FIG. 37 .

Referring to FIG. 38 , a user may enter a touch input in which thepointer P is dragged from a first location L1 to a second location L2 inthe touch region 10. The controller 3500 may calculate a touchcoordinate value corresponding to the touch input in real time andoutput a digitizer input on the basis of the calculated coordinatevalue.

The pointer P being displayed on the screen 10 may be processed by sucha digitizer input to move along a path corresponding to a drag path. Asa result, the pointer P may be moved from a first point D1 on the screen10 corresponding to the first location L1 in the touch region 3010 to asecond point D2 corresponding to the second location L2.

FIG. 39 is an example of an operation of the pointer P corresponding toa digitizer input of FIG. 37 .

Referring to FIG. 39 , a user may enter a touch input in which the firstlocation L1 in the touch region 10 is touched and then a touch input inwhich the second location L2 is touched without dragging or the like.When two such touch inputs are generated, the controller 3500 determinesthat the two touch inputs have an interval of a predetermined timeperiod or more. However, since the first location L1 and the secondlocation L2 are matched to the first point D1 and the second point D2 onthe screen 10, respectively, a digitizer input corresponding to thefirst location L1 may indicate the first point D1, and a digitizer inputcorresponding to the second location L2 may indicate the second pointD2. Accordingly, the pointer P displayed on the screen 10 may beprocessed by such a digitizer input to stay at the first point D1 on thescreen 10 when the first location L1 is touched and then to jump fromthe first point D1 to the second point D2 when the second location L2 istouched.

FIG. 40 is an example of mode switching of thepointing-device-integrated text input device of FIG. 30 .

Referring to FIG. 40 , the pointing-device-integrated text input device3000 may operate in the keyboard mode, a mouse mode, and a digitizermode.

Here, the keyboard mode is a mode in which, when a user performs avertical push input on a button 3100 arranged in a keyboard layout sothat the button 3100 can be moved downward by the push input to activatea switch 3200, the pointing-device-integrated text input device 3000 isallowed to input a keyboard input reflecting a key value allocated tothe button 3100 to which the push input is applied. The keyboard mode ismainly used for text input, and thus may be referred to as a “text mode”or “text input mode.”

Also, the mouse mode is a mode in which, when a user performs a touchinput in the touch region 3010 formed by the electrode 3130, thepointing-device-integrated text input device 3000 is allowed to controlmovement of the pointer P by means of the above-described mouse input.

Also, the digitizer mode is a mode in which when a user performs a touchinput in the touch region 3010 formed by the electrode 3130, thepointing-device-integrated text input device 3000 is allowed to controlthe movement of the pointer P by means of the above-described digitizerinput.

The mouse mode and digitizer mode are mainly used to control the pointerP, and thus may be referred to as a “pointing mode.” Also, both themouse mode and the digitizer mode are based on a touch input, and thusmay be referred to as a “touch mode” or “touch input mode.”

In this embodiment, the controller 3500 of thepointing-device-integrated text input device 3000 may switch among thethree modes. A mode switching method may be similar to theabove-described mode switching method of the mode switching unit, andthus a detailed description thereof will be omitted. However, directswitching between the keyboard mode and the digitizer mode may not beallowed during operation mode switching of thepointing-device-integrated text input device 3000. In this case, theswitching between the text mode and the digitizer mode may be achievedonly via the mouse mode.

When the pointing-device-integrated text input device 3000 enters thedigitizer mode through the mode switching, the controller 3500 mayprocess a touch input as a digitizer input.

To this end, the pointing-device-integrated text input device 3000 mayset the touch region 3010 corresponding to the screen 10.

FIG. 41 is an example of setting of the touch region 3010 correspondingto the digitizer mode of the pointing-device-integrated text inputdevice of FIG. 30 .

Referring to FIG. 41 , the touch region 3010 may be formed by the button3100 including the electrode 3130 for sensing a touch input. Typically,the touch region 3010 for a digitizer input may be formed in the shapeof a rectangle or the like on the keyboard layout. The rectangular touchregion 3010 may be matched to the screen 10.

As described above, a touch region for a mouse input may be implementedas right-hand and left-hand touch regions 108 a and 108 b, as shown inFIG. 1 .

FIGS. 42 and 43 are an example of a relationship between the touchregion 3010 corresponding to the digitizer mode of FIG. 41 and the touchregion corresponding to the mouse mode.

Referring to FIGS. 42 and 43 , an entire touchable region 3010′ includedin the pointing-device-integrated text input device 3000 is set as thetouch region 3010 used for the digitizer mode. Since such a touch region3010 is matched to the screen 10, the touch region 3010 may be set toinclude both the right-hand and left-hand touch regions 108 a and 108 b.

For example, as shown in FIG. 42 , when the pointing-device-integratedtext input device 3000 enters the digitizer mode from a right-hand mousemode in which a touch input is received from a user through theright-hand touch region 108 b of FIG. 1 , the entire region formed bythe right-hand and left-hand touch regions 108 a and 108 b beingcombined may be changed into the touch region 3010. It should beappreciated that, when the digitizer mode is switched back to the mousemode, the pointing-device-integrated text input device 3000 may sense atouch input through the right-hand touch region 108 b again.

On the other hand, for example, as shown in FIG. 43 , when thepointing-device-integrated text input device 3000 enters the digitizermode from a left-hand mouse mode in which a touch input is received froma user through the left-hand touch region 108 a of FIG. 1 , the entireregion formed by the right-hand and left-hand touch regions 108 a and108 b being combined may be changed into the touch region 3010. Itshould be appreciated that, when the digitizer mode is switched back tothe mouse mode, the pointing-device-integrated text input device 3000may sense a touch input through the left-hand touch region 108 a again.

An example in which the touch region 3010 is matched to the entirescreen 10 in the digitizer mode has been described above. However, inthis description, the pointing-device-integrated text input device 3000may set the touch region 3010 for the digitizer mode on the basis of theposition of the pointer P on the screen 10 when the digitizer mode isentered.

FIGS. 44 and 45 are an example of setting of the touch region 3010corresponding to the digitizer mode of the pointing-device-integratedtext input device of FIG. 30 .

Referring to FIGS. 44 and 45 , when the pointing-device-integrated textinput device 3000 enters the digitizer mode and then a touch input isfirst generated after entering into the digitizer mode, the controller3500 may calculate a touch input value of the corresponding touch inputand may set the touch region 3010 such that the calculated touchcoordinate value is matched to a point value of the pointer P on thescreen 10. Accordingly, as shown in FIGS. 44 and 45 , although thedigitizer mode is entered, a matching relationship between the screen 10and the touch region may be different when a touch input is first inputto a different position after entering into the digitizer mode.

That is, an example in which an entire touchable region 3010′ on thepointing-device-integrated text input device 3000 is set as the touchregion 3010 for the digitizer mode and the pointing-device-integratedtext input device 3000 matches the touch region 3010 for the digitizermode to the entire screen 10 has been described in FIG. 4 . Thus, thetouch region 3010 is always fixed on the screen 10. Accordingly, whenthe touch region 3010 is set in the same way as shown in FIG. 41 , auser cannot be aware of a precise touch coordinate value correspondingto the position of a pointer P in the touch region 3010. Accordingly, itmay be difficult for a user to perform a predetermined task at theposition of the pointer P on the screen 10. For example, it is assumedthat a user who performed a task in the mouse mode switches the mousemode to the digitizer mode to make an electronic signature at the pointat which the pointer P is present on the display. In this case, in orderto start signing, the user must go through a cumbersome task of findinga point at which the pointer P is present, that is, a start point of thesignature, before entering into the digitizer mode.

However, unlike this, in this embodiment, the point at which the pointerP is present is matched to the touch coordinate value of the touch inputthat is first applied after the digitizer mode is entered, and the touchregion 3010 is set according to the matching. Thus, the position atwhich the touch input is first applied is the point at which the pointerP is present. Accordingly, when the touch region 3010 is set in the sameway as shown in FIG. 44 or 45 , a user may perform a predetermined taskat the point at which the pointer P is present on the screen immediatelyafter the digitizer mode is entered without needing to be aware of aprecise touch coordinate value corresponding to the position of thepointer P within the entire touch region 3010. For example, it isassumed that a user who performed a task in the mouse mode switches themouse mode to the digitizer mode to make a signature at the point atwhich the pointer P is present on the display. In this case, the usermay perform a signing task from the point at which the pointer P ispresent only by starting signing at any touch position without goingthrough a cumbersome task of finding a point at which the pointer P ispresent before entering into the digitizer mode to start signing.

However, as shown in FIGS. 44 and 45 , when the touch region 3010 is setsuch that the point at which the pointer P is present on the screen 10when the digitizer mode is entered is matched to a touch coordinatevalue of a touch input that is first applied after the digitizer mode isentered, the touch region 3010 may cover only a portion of the screendepending on cases.

FIG. 46 is an example in which the outside of the touchable region 3010′is set as the touch region 3010 during the touch region setting of FIGS.44 and 45 .

As a detailed example, as shown in FIG. 46 , when the pointer P islocated at a lower right portion of the screen 10, a user may firstapply a touch input to an upper left portion of the actual touchableregion 3010′ of the pointing-device-integrated text input device afterthe digitizer mode is entered. In this case, the touch region 3010 forthe digitizer mode is intended to be matched to the actual screen 10,and a portion of the touch region 3010 to be set may be outside theentire actual touchable region 3010′.

Also, when the touch region 3010 is set in this way, the remainingportion of the actual touchable region 3010′ in thepointing-device-integrated text input device 3000 other than a portionoverlapping the touch region 3010 may not be matched to the screen 10,and thus may not be utilized as the touch region 3010 for the digitizermode.

Accordingly, when touch coordinates of a touch input that is firstapplied after the digitizer mode is entered are matched to coordinatesof the pointer P on the screen 10 and then the touch region 3010 for thedigitizer mode is set, a user can conveniently start a digitizer-typetouch input from a position at which the digitizer input is desired tobe applied, that is, from a position at which the pointer P is presenton the screen 10 when the digitizer mode is entered. However, when thetouch coordinates at which a touch is first applied to the entiretouchable region 3010′ is significantly different from the position ofthe pointer P on the screen 10 (e.g., when the pointer P is located in aleft portion, a right portion, an upper portion, or a lower portion ofthe screen 10 and the coordinates of the touch that is first appliedafter the digitizer mode is entered are located at the right portion,the left portion, the lower portion, or the upper portion), a portion ofthe screen 10 may not be matched to the touch region 3010 or manyportions of the entire touchable region 3010′ may not be matched to thescreen 10.

FIG. 47 is an example of resetting the touch region 3010 according tothe digitizer mode of FIG. 46 , and FIG. 48 is another example ofresetting the touch region 3010 according to the digitizer mode of FIG.46 .

Referring to FIGS. 47 and 48 , a coordinate value of the pointer Plocated at a lower right portion of the screen 10 is matched to a touchcoordinate value located at an upper left portion of the entiretouchable region 3010′, and a touch region 3010 a corresponding to thescreen 10 when the digitizer mode is entered is set on the basis of thematching. In this case, a portion of the touch region 3010 a is outsidethe touchable region 3010′ described above with reference to FIG. 46 .Accordingly, a touch input cannot be applied to a region of the screen10 that is matched to the touch region 3010 a outside the touchableregion 3010′. In this case, many portions of the touchable region 3010′do not correspond to the screen 10 described above with reference toFIG. 46 , and thus utilization of the touchable region 3010′ is alsolow.

Accordingly, it is necessary to move the touch region 3010 a so that thetouch region 3010 a and the screen 10 can be properly matched to eachother.

Accordingly, the pointing-device-integrated text input device 3000 mayreset the touch region 3010 for the digitizer mode that is matched tothe screen 10.

According to an example, referring to FIG. 47 , when a multi-fingertouch input (a touch input with two fingers in FIG. 47 ) applied to thepredetermined touch region 3010 a is received in the digitizer mode, thepointing-device-integrated text input device 3000 may reset the touchregion 3010 by changing a touch region 3010 b according to movement oftouch coordinates of the multi-finger touch input.

According to another example, referring to FIG. 48 , when a touch inputis received in an external region of the touchable region 3010′, whichis not included in the predetermined touch region 3010 a, in thedigitizer mode, the pointing-device-integrated text input device 3000may reset the touch region 3010 by changing the touch region 3010 baccording to movement of touch coordinates of the touch input.

According to still another example, the pointing-device-integrated textinput device 3000 may enter a standby state in which the touch region3010 for the digitizer mode receives an input for resetting the touchregion 3010 by a predetermined user input through a mode switching unitwhile the touch region 3010 is matched to the screen 10. When a touchinput is received in the standby state, the pointing-device-integratedtext input device 3000 may reset the touch region 3010 by moving thetouch region 3010 according to the movement of the touch input.

In addition to the aforementioned examples, thepointing-device-integrated text input device 3000 may determine variousconditions as a touch region resetting request, may wait to receive atouch region resetting input when the touch region resetting request isgenerated, and may move the touch region 3010 according to movement of atouch input which will occur later to move the touch region 3010 for thedigitizer mode.

Some methods of the pointing-device-integrated text input device 3000performing control operations associated with the digitizer mode will bedescribed below.

FIG. 49 is a flowchart showing an example of a mode switching method ofthe pointing-device-integrated text input device 3000 of FIG. 30 .

Referring to FIG. 49 , the method may include acquiring informationregarding an input mode (S3110), determining the input mode (S3120),activating the switches 3200 when the input mode is the keyboard modeand deactivating the electrode 3130 (S3131), acquiring a push input(S3132), raising or lowering the button body 3120 (S3133), acquiring akey identifier (S3134), acquiring a key value (S3135), deactivating theswitches 3200 and activating the electrode 3130 when the input mode isthe mouse mode (S3121), acquiring a touch input (S3122), changingcapacitance (S3123), acquiring a touch coordinate value (S3124),acquiring a mouse input (S3125), deactivating the switches 3200 andactivating the electrode 3130 when the input mode is the digitizer mode(S3131), acquiring a touch input (S3132), changing capacitance (S3133),acquiring a touch coordinate value (S3134), and acquiring a digitizerinput (S3135).

The above-described steps will be described in detail below.

The pointing-device-integrated text input device 3000 may acquireinformation regarding an input mode (S3110) and may determine the inputmode according to the acquired information (S3120). Here, the input modemay include the keyboard mode, the mouse mode, and the digitizer mode,and switching among these modes by the pointing-device-integrated textinput device 3000 may be either completely free or limited.

When the input mode is the keyboard mode, the pointing-device-integratedtext input device 3000 may output a key value as a keyboard inputaccording to a push-input-type user input.

First, the pointing-device-integrated text input device 3000 mayactivate the switch 3200 and deactivate the electrode 3130 (S3131).

Here, the activation of the switch 3200 may refer to a state in which,when the switch 3200 is touched or pressed by the button body 3120according to the push input, the controller 3500 may receive a keyidentifier from the switch 3200, acquire a key value according to thekey identifier, and transmit a keyboard input reflecting the key valueto a device or unit that uses the pointing-device-integrated text inputdevice 3000 as an input interface.

Conversely, the deactivation of the switch 3200 may refer to a state inwhich the pointing-device-integrated text input device 3000 does notperform some or all of the process of finally transmitting the keyboardinput according to the user's push input during the above-describedactivation state of the switch 3200 such that the keyboard input is notoutput in response to the push input.

Here, the activation of the electrode 3130 may refer to a state inwhich, when a user performs a touch input, the controller 3500 may applya drive signal to the electrode 3130 to generate capacitance in theelectrode 3130, detect a change in the capacitance of the electrode 3130as a scan signal according to the touch input, calculate a touchcoordinate value and touch information according to the scan signal,acquire a mouse input or a digitizer input on the basis of the touchcoordinate value and the touch information, and transmit the mouse inputor the digitizer input to a device or unit that uses thepointing-device-integrated text input device 3000 as an input interface.

Conversely, the deactivation of the electrode 3130 may refer to a statein which the pointing-device-integrated text input device 3000 does notperform some or all of the process of finally transmitting the mouseinput or the digitizer input according to the user's touch input duringthe above-described activation state of the electrode 3130 such that themouse input or the digitizer input is not output in response to thetouch input.

The pointing-device-integrated text input device 3000 may acquire a pushinput through the keycap 3110 (S3132). Thus, the button body 3120 may bemoved downward (S3133), the switch 3200 may acquire a key identifier(S3134), and the controller 3500 may receive the key identifier, acquirea key value, and acquire a keyboard input including the key value(S3135).

The pointing-device-integrated text input device 3000 may function as akeyboard by delivering the keyboard input to an entity that uses thepointing-device-integrated text input device 3000 as an input interface.

When the input mode is the mouse mode, the pointing-device-integratedtext input device 3000 may output a mouse input according to atouch-input-type user input.

First, the pointing-device-integrated text input device 3000 maydeactivate the switch 3200 and activate the electrode 3130 (S3141).However, only some of the switches 3200 may be deactivated or all of theswitches 3200 may be activated as necessary.

When a touch input is applied to the pointing-device-integrated textinput device 3000 through the keycap 3110 (S3142), the capacitance ofthe electrode 3130 generated by the drive signal may change (S3143). Thecontroller 3500 may receive a scan signal reflecting the change in thecapacitance, and thus may acquire a touch coordinate value (S3144).

When the touch coordinate value is acquired, the controller 3500 maycalculate a touch coordinate variation through a difference operationbetween a touch coordinate value acquired during a previous scan periodand a current touch coordinate value, and generate a mouse inputreflecting the calculated touch coordinate variation (3145).

The pointing-device-integrated text input device 3000 may function as amouse by delivering the mouse input to an entity that uses thepointing-device-integrated text input device 3000 as an input interface.

When the input mode is the digitizer mode, thepointing-device-integrated text input device 3000 may output a digitizerinput according to a touch-input-type user input.

First, the pointing-device-integrated text input device 3000 maydeactivate the switch 3200 and activate the electrode 3130 (S3151).However, only some of the switches 3200 may be deactivated or all of theswitches 3200 may be activated as necessary.

When a touch input is applied to the pointing-device-integrated textinput device 3000 through the keycap 3110 (S3152), the capacitance ofthe electrode 3130 generated by the drive signal may change (S3153). Thecontroller 3500 may receive a scan signal reflecting the change in thecapacitance, and thus may acquire a touch coordinate value (S3154).

When the touch coordinate value is acquired, the controller 3500 maygenerate a digitizer input indicating a specific point on the screen 10from the touch coordinate value in consideration of a matchingrelationship between the screen 10 and the touch region 3010 for thedigitizer mode (S3155).

The pointing-device-integrated text input device 3000 may function as adigitizer by delivering the digitizer input to an entity that uses thepointing-device-integrated text input device 3000 as an input interface.

FIG. 50 is a flowchart showing a touch input processing method in themouse mode and the digitizer mode of the pointing-device-integrated textinput device 3000 of FIG. 30 .

Referring to FIG. 50 , the method may include acquiring a touch input(S3210), calculating a touch coordinate value (S3220), determining amode (S3230), calculating a relative coordinate value on the basis of aprevious touch coordinate value and a current touch coordinate valuewhen the mode is the mouse mode (S3240), outputting a mouse inputaccording to the relative coordinate value (S3250), calculating anabsolute coordinate value from the touch coordinate value inconsideration of a matching relationship between a touch region and ascreen region when the mode is the digitizer mode (S3260), andoutputting a digitizer input according to the absolute coordinate value(S3270).

The above-described steps will be described in detail below.

The pointing-device-integrated text input device 3000 may acquire atouch input (S3210) and calculate a touch coordinate value according tothe touch input (S3220).

When the touch coordinate value is calculated, the controller 3500 maydetermine whether the current mode is the mouse mode or the digitizermode (S3230).

When the mode is the mouse mode, the controller 3500 may calculate arelative coordinate value on the basis of a touch coordinate valueduring a previous scan period and a touch coordinate value during acurrent scan period (S3240), and may output a mouse input reflecting therelative coordinate value (S3250).

When the mode is the digitizer mode, the controller 3500 may calculatean absolute coordinate value from the touch coordinate value inconsideration of a matching relationship between a touch region and ascreen region (S3260), and may output a digitizer input according to theabsolute coordinate value (S3270).

Here, the process of the controller 3500 acquiring the digitizer inputfrom the touch coordinate value is as follows.

As an example, the matching relationship may be a matching table or amatching function between resolution coordinate values of the screen 10corresponding to the coordinate values of the touch region 3010. In thiscase, the controller 3500 may change the touch coordinate value into acoordinate value on the screen 10 by using the matching table or thematching function, and may acquire a digitizer input reflecting thecoordinate value on the screen 10.

As another example, the matching relationship may denote that a touchcoordinate value of a touch input that is first applied after thedigitizer mode is entered corresponds to a resolution coordinate valueof the pointer P on the screen 10 when the first touch input is input.In this case, the controller 3500 may acquire a difference between atouch coordinate value of a start touch input and a touch coordinatevalue of a current touch input as the digitizer input. , Such a methodmay be technically substantially the same as a method of setting amatching relationship between the screen 10 and the touch region 3010according to the coordinate value of the first touch input andconverting the touch coordinate value into an absolute coordinate valueaccording to the matching relationship, but may have a slightlydifferent signal/information processing/operating process.

FIG. 51 is a flowchart showing an example of a method of thepointing-device-integrated text input device 3000 of FIG. 30 setting atouch region in the digitizer mode.

Referring to FIG. 51 , the method may include entering the mouse mode(S3310), determining whether the mouse mode is a right-hand mode or aleft-hand mode (S3320), setting a touch region on the basis of whetherthe mouse mode is the right-hand mode or the left-hand mode (S3330),receiving the digitizer mode request (S3340), entering the digitizermode (S3350), setting an entire touchable region as the touch region(S3360), matching the touch region to a screen region on the basis of ascreen resolution (S3370), acquiring a touch input and calculating atouch coordinate value (S3380), and acquiring a digitizer input on thebasis of the touch coordinate value in consideration of a matchingrelationship between the screen resolution and the touch region (S3390).

The above-described steps will be described in detail below.

First, the pointing-device-integrated text input device 3000 enters themouse mode (S3310). In this case, the pointing-device-integrated textinput device 3000 may determine whether the mouse mode is a right-handmode or a left-hand mode (S3320), and may set a different touch regiondepending on whether the mouse mode is the right-hand mode or theleft-hand mode (S3330). The determination of whether the mouse mode isthe right-hand mode or the left-hand mode and the setting of the touchregion have been described above, and thus detailed descriptions thereofwill be omitted.

The pointing-device-integrated text input device 3000 may receive arequest to switch from the mouse mode to the digitizer mode through amode switching unit or the like (S3340), and may enter the digitizermode (S3350).

When the digitizer mode is entered, the pointing-device-integrated textinput device 3000 may set the entire touchable region as the touchregion (S3360) and match the touch region to the screen region on thebasis of the resolution of the screen 10 (S3370). In detail, a matchingtable or function, which is a table or function for matching fourcorners of the touch regions 3010 to four corners of the screen 10, maybe generated.

The pointing-device-integrated text input device 3000 may acquire atouch input and calculate a touch coordinate value corresponding to thetouch input (S3380), and may acquire a digitizer input on the basis ofthe touch coordinate value in consideration of a matching relationshipbetween the screen resolution and the touch region (S3390). In thiscase, the digitizer input may indicate a predetermined point on thescreen 10. However, the pointing-device-integrated text input device3000 may simply transmit the touch coordinate value to a device, and thedevice may convert the touch coordinate value into a coordinate value onthe screen 10.

FIG. 52 is a flowchart showing another example of a method of thepointing-device-integrated text input device 3000 of FIG. 30 setting atouch region in the digitizer mode.

Referring to FIG. 52 , the method includes switching from the mouse modeto the digitizer mode (S3410), acquiring a first touch input (S3420),calculating a coordinate value of the first touch input (S3430),acquiring a matching relationship between a touch region and a screen onthe basis of the calculated coordinate value and a position of a pointeron the screen, and setting the touch region on the basis of the matchingrelationship (S3450).

The above-described steps will be described in detail below.

The pointing-device-integrated text input device 3000 may switch fromthe mouse mode to the digitizer mode (S3410), acquire a touch input thatis first applied after the digitizer mode is entered (S3420), andcalculate a touch coordinate value corresponding to the touch input(S3430).

The pointing-device-integrated text input device 3000 may acquire amatching relationship between the touch region and a screen on the basisof the calculated coordinate value and the position of the pointer P onthe screen 10 (S3440). That is, the controller 3500 may generate amatching table or a matching function for making a touch point of thefirst touch correspond to the position of the pointer P on the screen10.

When the matching relationship is formed, the pointing-device-integratedtext input device 3000 may set the touch region on the basis of thematching relationship (S3450). The controller 3500 may set the touchregion so that the touch coordinate value of the first touch in thetouch region can correspond to a point at which a pointer is presentwhen the first touch is input.

Thus, touch coordinate values in the touch region may be matched toresolution values of the screen 10 and used in the form in which thetouch region receives a digitizer input.

Instead of implementing a matching table or function for forming thematching relationship, it is possible to control movement of the pointeron the screen on the basis of a difference between a coordinate value ofthe first touch input and a coordinate value of a subsequent touchinput. In the mouse mode, a method of controlling movement of a pointerby calculating a touch coordinate variation through a differenceoperation between a touch coordinate value during a current scan periodand a touch coordinate value during a previous scan period has beendescribed. In the digitizer mode, although a matching relationship isnot formed, a point at which the pointer is present when the first touchinput is input is matched to a touch coordinate value of the first touchinput in the touch region. Thus, it is also possible to controlsubsequent movements of the pointer by using the touch coordinatevariation calculated through the difference operation between the touchcoordinate value of the first touch input and the touch coordinate valueof the current touch input.

FIG. 53 is a flowchart showing a method of thepointing-device-integrated text input device 3000 of FIG. 30 resetting atouch region in the digitizer mode.

Referring to FIG. 53 , the method may include receiving a touch regionresetting request for the digitizer mode (S3510), resetting a touchregion according to the resetting request (S3520), acquiring a touchinput (S3530), calculating a touch coordinate value (S3540), andacquiring a digitizer input on the basis of the touch coordinate valuein consideration of a matching relationship between a screen resolutionand the touch region.

The above-described steps will be described in detail below.

The pointing-device-integrated text input device 3000 may receive thetouch region resetting request for the digitizer mode (S3510). Adetailed aspect of the resetting request has been described, and thus adetailed description thereof will be omitted.

When the resetting request is received, the pointing-device-integratedtext input device 3000 may reset the touch region (S3520). In detail,the controller 3500 may reset the touch region by moving the touchregion according to the movement of a touch input that is input afterthe resetting request.

In detail, the pointing-device-integrated text input device 3000 mayacquire a touch input (S3530), calculate a touch coordinate value of theacquired touch input (S3540), and acquire a digitizer input on the basisof the touch coordinate value in consideration of a matchingrelationship between a screen resolution and the touch region (S3550).

When the touch region is reset using the above-described multi-touchinput or when the touch region is reset using a touch input applied to atouchable region outside the touch region, a touch region resettingrequest and a subsequent touch region moving command may be interpretedas being merged.

In the above-description, by default, the pointing-device-integratedtext input device 3000 receives only a key input and does not recognizea touch input in the keyboard mode or receives only a touch input anddoes not recognize a key input in the mouse mode.

Actually, when the pointing-device-integrated text input device 3000senses a touch input in the keyboard mode, the pointer P on the screen10 may not be moved consistently with a user's intent because of typing,and thus it may be advantageous for a touch input to not be recognizedin the keyboard mode. Furthermore, the pointing-device-integrated textinput device 3000 periodically processes a drive signal and a scansignal in order to sense the touch input, and thus may cause unnecessarypower waste.

However, in the touch mode (the mouse mode or the digitizer mode), thereis no great inconvenience in controlling the position of the pointer Peven when the pointing-device-integrated text input device 3000recognizes a key input.

A method of the pointing-device-integrated text input device 3000utilizing a key input in the touch mode will be described below.

In a computing environment or the like, it may be necessary to adjustattributes that are tunable during operation of an operating system orexecution of an application. The attributes are referred to below as“adjustment target attributes.”

FIG. 54 is a view showing some examples of adjustment target attributes.

Representative examples of the adjustment target attributes include avolume attribute 12 a related to sound volume of audio, a progress-barattribute 12 b related to progress of video playback, and a color spaceattribute 12 c related to an adjustment of color values, as shown inFIG. 54 , and also various other adjustment target attributes.

Conventionally, various methods have been designed to adjust attributevalues of the adjustment target attributes.

As an example, a user may adjust adjustment target attributes byentering a character value or a key value allocated to the adjustment ofthe adjustment target attributes. In detail, an attribute value of thevolume attribute may increase when a “+” key of a keyboard is enteredand may decrease when a “−” key is entered.

As another example, a user may move an indicator located on a graphicobject reflecting the attribute value of the adjustment target attributeby dragging the indicator.

However, when the attribute value of the adjustment target attribute isadjusted through a key input, a large number of key inputs may berepeatedly required. When the indicator located on the graphic object ismoved by dragging the indicator corresponding to a mouse input, a usershould perform a drag input after moving the pointer P to a position ofthe indicator of the graphic object.

In this description, the pointing-device-integrated text input device3000 may adjust an adjustment target attribute by utilizing a keyboardinput while operating in the touch mode. Some implementations thereofwill be described below.

FIG. 55 is a diagram showing a matching relationship between anadjustment target attribute and the button 3100.

Referring to FIG. 55 , while the pointing-device-integrated text inputdevice 3000 operates in the touch mode, the key input is deactivated bydefault. However, some keys may be set to recognize a key input. Also,adjustment target attributes may be allocated to key values of some ofthe buttons 3100 through which key inputs may be recognized.

That is, the controller 3500 may allocate an adjustment target attributeto a key value or a key identifier corresponding to at least onespecific button 3100 in the touch mode. When a key input of the specificbutton 3100 is generated in the touch mode, the controller 3500 mayacquire and output the corresponding key input as a keyboard inputindicating a shortcut key of an adjustment target attribute. Forexample, an “A” button 3100 a, a “P” button 3100 b, and a “C” button3100 c may correspond to an attribute regarding audio volume, anattribute regarding a progress bar of a media player, and an attributeregarding a color space of a picture application, respectively.

When a key input is generated in the touch mode, the controller 3500 maydetermine whether a predetermined adjustment target attribute isallocated to a key identifier of a switch 3200 of a corresponding key orwhether a key value having a predetermined adjustment target attributeis allocated to the key identifier of the switch 3200 of thecorresponding key.

When an adjustment target attribute is allocated to a correspondingbutton 3100, the controller 3500 may recognize a subsequent touch input,acquire/transmit a mouse input or a digitizer input according to a touchcoordinate value corresponding to the touch input, and enable anelectronic device that received the mouse input or the digitizer inputto adjust an attribute value of the adjustment target attributeaccording to the touch input.

To this end, the controller 3500 may generate shortcut key informationfor instructing that an adjustment target attribute be invoked or thatan adjustment of the adjustment target attribute according to a keyvalue, which is generated by a key input relative to the button 3100 towhich the adjustment target attribute is allocated, be adjusted, and maydeliver the generated shortcut key information to an electronic device.

As an example, a user may perform key input on the button 3100 to whichan adjustment target attribute is allocated while thepointing-device-integrated text input device 3000 is operating in thetouch mode. In this case, the controller 3500 may acquire acorresponding key identifier.

When the pointing-device-integrated text input device 3000 is operatingin the keyboard mode, the controller 3500 may acquire and/or output thekey value as a keyboard input reflecting a character value or a valueused in a conventional keyboard (e.g., a value of an ESC key and a valueof a Caps Lock key).

However, when the pointing-device-integrated text input device 3000 isoperating in the touch mode, the controller 3500 may acquire a keyidentifier and determine whether an adjustment target attribute isallocated to the key identifier. When an adjustment target attribute isnot allocated to the key identifier, the key input is ignored.

On the other hand, when an adjustment target attribute is allocated tothe key identifier, the controller may output a subsequent touch inputin the form of a mouse/digitizer input that is used to adjust anattribute value of the adjustment target attribute. Also, during thisprocess, the controller 3500 may transmit and/or output information foridentifying the adjustment target attribute or a signal for instructingthat the adjustment target attribute be activated or invoked.

Here, when an adjustment target attribute is invoked or activated, a baror plane for displaying an adjustment range of the adjustment targetattribute and a graphic object including an indicator indicating acurrent attribute value may be output on the screen.

FIGS. 56 and 57 are diagrams showing an example in which thepointing-device-integrated text input device 3000 adjusts an adjustmenttarget attribute.

The example will be described below with reference to FIG. 56 .

When a key input relative to the “A” button is generated in a mode otherthan the touch mode, the pointing-device-integrated text input device3000 may output a key value of the letter “A.” Also, when a key inputrelative to the “A” button is generated in the touch mode, thepointing-device-integrated text input device 3000 may acquire a keyvalue indicating an audio volume attribute from the key input relativeto the “A” button and may output a signal for performing activation orinvocation such that the audio volume attribute can be adjustable to anentity that uses the pointing-device-integrated text input device 3000as an input interface.

Next, the controller 3500 may process a touch input that is appliedafter a key input associated with the adjustment target attribute isgenerated as an attribute adjustment value for adjusting an attributevalue of the adjustment target attribute. The adjustment targetattribute may be adjusted according to the attribute adjustment value.

In detail, a touch input that moves from a lower portion to an upperportion in a keyboard layout may increase an attribute value of thevolume attribute. Also, a touch input that moves from the upper portionto the lower portion in the keyboard layout may decrease the attributevalue of the volume attribute.

As described above, when the touch input is utilized as an input foradjusting a value of an adjustment target attribute rather than a mouseinput for moving the position of the pointer P, the touch input may bereferred to as an attribute adjustment input.

The attribute adjustment input may be provided by adding an adjustmenttarget attribute to the mouse input, the digitizer input, or the like.Alternatively, the attribute adjustment input may be provided by makinga touch coordinate value correspond to an attribute value.

That is, in FIG. 56 , the pointing-device-integrated text input device3000 may deliver a mouse input or a digitizer input corresponding tomovement from a first touch position A1 to a second touch position A2and information indicating an audio volume attribute, which is anadjustment target attribute, to an electronic device. The electronicdevice may output a graphic object corresponding to the audio volumeattribute to a screen according to the information indicating the audiovolume attribute and may adjust the attribute value from a firstattribute value a1 to a second attribute value a2 according to asubsequent mouse input or digitizer input. In this case, the electronicdevice may move an indicator 12 a′ indicating the attribute value.

The example will be described below with reference to FIG. 57 .

When a key input relative to the “P” button is generated in a mode otherthan the touch mode, the pointing-device-integrated text input device3000 may output a key value of the letter “P.” Also, when a key inputrelative to the “P” button is generated in the touch mode, thepointing-device-integrated text input device 3000 may acquire a keyvalue indicating a media player playback attribute from the key inputrelative to the “P” button and may output a signal for performingactivation or invocation so that the playback attribute can beadjustable to an entity that uses the pointing-device-integrated textinput device 3000 as an input interface.

Subsequently, when a horizontal touch input is applied between a thirdtouch position B1 and a fourth touch position B2, the playback attributemay be adjusted between a third attribute value b1 and a fourthattribute value b2.

Here, the adjustment target attribute may generally have a 1D attributevalue. The adjustment target attribute having a 1D attribute value maybe represented using a graphic object that includes a bar correspondingto an adjustment range represented with a minimum value and a maximumvalue and an indicator indicating a current attribute value on the bar.Also, the graphic object may be represented as a dial-type graphicobject in which an attribute value is adjusted in a clockwise orcounter-clockwise direction depending on cases.

However, all adjustment target attributes having a 1D attribute valueare not represented using a graphic object.

The above-described adjustment target attribute having a 1D attributevalue and represented with a graphic object including a bar and anindicator may be adjusted by vertically or horizontally moving apointer. A direction in which the pointer is moved to adjust theattribute value may be defined as an attribute adjustment direction. Forexample, the above-described volume attribute has a vertical attributeadjustment direction, and the above-described playback attribute has ahorizontal attribute adjustment direction.

Accordingly, when a touch input of the pointing-device-integrated textinput device 3000 is used to adjust an attribute value of an adjustmenttarget attribute. In detail, the controller 3500 may correct a touchcoordinate value in consideration of the attribute adjustment directionand may acquire and/or output an attribute adjustment input on the basisof the corrected touch coordinate value.

FIG. 58 is a diagram showing another example in which thepointing-device-integrated text input device 3000 adjusts an adjustmenttarget attribute.

As an example, referring to FIG. 58 , the volume attribute shown in FIG.58 has a vertical attribute adjustment direction on the screen 10. Inthis case, when the pointing-device-integrated text input device 3000receives a request to adjust the volume attribute through the “A” button3100 a, the controller 3500 may generate an attribute adjustment inputaccording to a subsequent touch input. In this case, the controller 3500may determine that the volume attribute is allocated to the “A” buttonand may determine that the attribute adjustment direction of the volumeattribute is a vertical direction. When a subsequent touch input isgenerated, the controller 3500 may correct the touch coordinate valueaccording to the attribute adjustment direction. That is, although afifth touch A1′ and a sixth touch A2′ are performed in a diagonaldirection, as shown in FIG. 58 , the attribute adjustment direction ofthe volume attribute is the vertical direction in which the firstattribute value a1 and the second attribute value a2 are arranged. Thus,the controller 3500 may process an attribute adjustment input foradjusting an attribute value by using only a vertical touch coordinatevalue obtained by removing a horizontal component from the diagonaltouch input.

FIG. 59 is a diagram showing still another example in which thepointing-device-integrated text input device 3000 adjusts an adjustmenttarget attribute.

The adjustment target attribute has been described as mainly having a 1Dattribute value, but there is an adjustment target attribute having atwo-dimensional (2D) attribute value such as a color space or a colorcoordinate depending on cases.

FIG. 59 shows a color plane 12 c having a 2D attribute value. When the“C” button 3100 c to which a color plane is applied is pressed, thepointing-device-integrated text input device 3000 may process asubsequent 2D touch coordinate value as an attribute adjustment inputfor adjusting a 2D attribute value.

As described above, when a keyboard input of a button associated with anadjustment target attribute is applied in a general touch mode, thepointing-device-integrated text input device 3000 may enter the touchmode for controlling an attribute value of the adjustment targetattribute from the general touch mode. The attribute value of theadjustment target attribute may be interpreted as being adjustedaccording to a touch input in the touch mode.

Like this, there are various ways to process the touch input as an inputfor adjusting the attribute value of the adjustment target attribute.Some examples thereof will be described below.

First, when a key identifier allocated to a button 3100 indicating anadjustment target attribute is received in the touch mode, thecontroller 3500 may enter the attribute adjustment mode.

Here, a method of entering the attribute adjustment mode may be asfollows.

As an example, when a key identifier of the button 3100 indicating theadjustment target attribute is received in the general touch mode, thecontroller 3500 may enter the attribute adjustment mode. Also, when thekey identifier of the button 3100 indicating the adjustment targetattribute is received in the attribute adjustment mode again, thecontroller 3500 may exit the attribute adjustment mode. In this case,the controller 3500 may return to the general touch mode again. Thecontroller 3500 may process a touch input applied until the controller3500 enters and then exits the attribute adjustment mode as an attributeadjustment input. Also, in this case, a key value indicating theattribute adjustment mode may be generally allocated to the ESC key orthe like.

As another example, when the key identifier of the button 3100indicating the adjustment target attribute is received in the generaltouch mode, the controller 3500 may enter the attribute adjustment mode.In this situation, the controller 3500 may process a one-time touchinput as an attribute adjustment input. When the one-time touch input isended, the controller 3500 may exit the attribute adjustment mode andreturn to the general touch mode.

As still another example, when the key identifier of the button 3100indicating an adjustment target attribute is received in the generaltouch mode, the controller 3500 may maintain the attribute adjustmentmode while the button 3100 is pressed. When the button 3100 is released,the controller 3500 exits the attribute adjustment mode. The controller3500 may process a touch input that is applied until the controller 3500enters and then exits the attribute adjustment mode as the attributeadjustment input. The controller 3500 may exit the attribute adjustmentmode and return to the general touch mode.

Here, it has been described that the pointing-device-integrated textinput device 3000 may enter the attribute adjustment mode and process atouch input applied in the attribute adjustment mode as an attributeadjustment input. However, there may not be a separate mode referred toas the attribute adjustment mode, and the pointing-device-integratedtext input device 3000 may process, a touch input that is applied undera specific condition as the attribute adjustment input. Here, thespecific condition may be similar to the above-described example.

FIG. 60 is a diagram showing a first example in which thepointing-device-integrated text input device 3000 processes a touchinput for adjusting an adjustment target attribute.

According to the first example, referring to FIG. 60 , the touch inputof the pointing-device-integrated text input device 3000 which is in theattribute adjustment mode is processed similarly to that of theabove-described mouse input. However, instead of calculating a mouseinput from a touch coordinate value, it is possible to calculate themouse input by using a corrected touch coordinate value in considerationof an attribute adjustment direction. An attribute value of anadjustment target attribute may be increased or decreased depending onthe attribute adjustment input processed similarly to that of the mouseinput.

In detail, for the audio volume attribute 12 a′ having a verticalattribute adjustment direction, the attribute value and a position of anindicator 13 indicating the volume attribute value may be adjusted by avertical touch input.

FIG. 61 is a diagram showing a second example in which thepointing-device-integrated text input device 3000 processes a touchinput for adjusting an adjustment target attribute.

According to the second example, referring to FIG. 61 , when theattribute adjustment mode is entered, the touch input of thepointing-device-integrated text input device 3000 may match a touchregion to an adjustment range of an attribute value of an attributetarget attribute to perform an attribute adjustment. Thepointing-device-integrated text input device 3000 may process asubsequent touch input in a similar way to that of a digitizer input toacquire an attribute adjustment input.

In detail, for the audio volume attribute 12 a′ having a verticalattribute adjustment direction, the touch input of thepointing-device-integrated text input device 3000 may set a touch regionfor a touch input relative to the attribute adjustment input such that amaximum volume value and a minimum volume value are matched to a topportion and a bottom portion of the touchable region 3010′. To this end,the controller 3500 may acquire an attribute value range and may set thetouch region on the basis of the attribute value range. By using asubsequent touch input for an attribute arrangement, the controller 3500may determine that touch coordinate values of a top coordinate value anda bottom coordinate value of the touch region are a maximum attributevalue and a minimum attribute value, respectively.

FIG. 62 is a diagram showing a third example in which thepointing-device-integrated text input device 3000 processes a touchinput for adjusting an adjustment target attribute.

According to the third example, referring to FIG. 62 , the touch inputof the pointing-device-integrated text input device 3000 may match atouch coordinate value of a touch input that is first applied after theattribute adjustment mode (hereinafter, a touch input that is firstapplied after a specific mode is entered is referred to as a “starttouch input,” and a touch coordinate value of the start touch input isreferred to as a “start touch coordinate value”) is entered to a currentattribute value of an adjustment target attribute. That is, thecontroller 3500 may make a start coordinate touch value correspond to acurrent attribute value, and then may generate an attribute adjustmentinput to adjust the attribute value by using a variation of a startcoordinate touch value of a subsequent touch coordinate value.

FIG. 63 is a diagram showing a fourth example in which thepointing-device-integrated text input device 3000 processes a touchinput for adjusting an adjustment target attribute.

According to the fourth example, referring to FIG. 63 , thepointing-device-integrated text input device 3000 may process a touchinput that is continuously applied from a time point at which a touchinput performed by a push input relative to a button 3100, to which anadjustment target attribute is allocated, is input as a touch input forattribute adjustment.

In detail, when a user pushes the “P” button 3100 b indicating a mediaplayer playback attribute 12 b, the pointing-device-integrated textinput device 3000 may acquire a touch input starting from the “P” button3100 b in addition to the push input. The controller 3500 may process atouch coordinate value of a touch input that is performed until thetouch input starting from the “P” button 3100 b is released as anattribute adjustment input,.

FIG. 64 is a diagram showing a fifth example in which thepointing-device-integrated text input device 3000 processes a touchinput for adjusting an adjustment target attribute.

According to the fifth example, referring to FIG. 64 , thepointing-device-integrated text input device 3000 may process a touchinput that is continuously applied from a time point at which a touchinput performed by a push input relative to a button 3100, to which anadjustment target attribute is allocated, is input as a touch input foran attribute adjustment.

In detail, when a user pushes the “P” button 3100 b indicating the mediaplayer playback attribute 12 b, the pointing-device-integrated textinput device 3000 may acquire a touch input starting from the “P” button3100 b in addition to the push input. The controller 3500 may process atouch input that is subsequently sensed on the electrode 3130 in the “P”button 3100 b as an attribute adjustment input.

A sensing region provided for a single button may not be sufficientlywide. In this case, the controller 3500 may process an attributeadjustment input on the basis of a touch input that rotates clockwise orcounterclockwise about the button. For example, the clockwise touchinput may be processed as an input for increasing an attribute value,and counterclockwise touch input may be processed as an input fordecreasing an attribute value. As a detailed example, the clockwisetouch input may be processed as an input for moving an indicator on aprogress bar to the right and moving a play time of the playbackattribute 12 b backward, and the counterclockwise touch input may beprocessed as an input for moving the indicator on the progress bar tothe left and moving the play time of the playback attribute 12 bforward.

FIG. 65 is a diagram showing a sixth example in which thepointing-device-integrated text input device 3000 processes a touchinput for adjusting an adjustment target attribute.

According to the sixth example, referring to FIG. 65 , when anadjustment target attribute has a 2D attribute value, a touch region forreceiving a touch input for adjusting the adjustment target attributemay also be set in the form of a 2D plane. That is, a touch regionmatched to a region of a graphic object reflecting the 2D attributevalue may be set in the attribute adjustment mode. In FIG. 65 , thecolor plane 12 c and the entire touchable region 3010′ may be matched toeach other.

FIG. 66 is a diagram showing a seventh example in which thepointing-device-integrated text input device 3000 processes a touchinput for adjusting an adjustment target attribute.

According to the seventh example, referring to FIG. 66 , when anadjustment target attribute has a 2D attribute value, a touch region forreceiving a touch input for adjusting the adjustment target attributemay also be set in the form of a 2D plane. That is, a touch regionmatched to a region of a graphic object reflecting the 2D attributevalue may be set in the attribute adjustment mode. In FIG. 66 , a touchregion in which a touch coordinate value and a position of the pointer Pon the color plane 12 c may be set for each touch.

Some examples for processing a touch input as an attribute adjustmentinput have been described. However, it should be noted that the methodof processing a touch input as an attribute adjustment input is notlimited to the above examples.

Some methods in which the pointing-device-integrated text input device3000 adjusts an attribute value of an adjustment target attribute willbe described below.

FIG. 67 is a flowchart showing an example in which thepointing-device-integrated text input device 3000 adjusts an adjustmenttarget attribute.

Referring to FIG. 67 , the method may include entering a touch inputmode (S3610), acquiring a push input indicating an adjustment targetattribute (S3620), activating the adjustment target attribute (S3630),acquiring a touch input (S3640), and adjusting the adjustment targetattribute on the basis of the touch input (S3650).

The above-described steps will be described in detail below.

The pointing-device-integrated text input device 3000 enters the touchinput mode (S3610). In this case, the touch input mode may correspond tothe above-described mouse mode or digitizer mode. Here, thepointing-device-integrated text input device 3000 may activate theelectrode 3130 to detect a touch input. However, thepointing-device-integrated text input device 3000 does not deactivateall of the switches 3200 and activates at least those switches 3200 ofbuttons 3100 to which an adjustment target attribute is allocated.

The pointing-device-integrated text input device 3000 may acquire a pushinput indicating an adjustment target attribute (S3620). When a pushinput relative to a button 3100 having a key value or a key identifierto which the adjustment target attribute is allocated among a pluralityof activated buttons 3100 is received, the controller 3500 may acquirethe key value or the key identifier and activate the allocatedadjustment target attribute according to the acquired key value or keyidentifier (S3630). While performing the activation, thepointing-device-integrated text input device 3000 may invoke theadjustment target attribute or deliver a signal for making a request todisplay a graphic object of the adjustment target to an electronicdevice.

When the adjustment target attribute is activated or when thepointing-device-integrated text input device 3000 enters the attributeadjustment mode for the adjustment target attribute, thepointing-device-integrated text input device 3000 may acquire a touchinput (S3640), and may adjust the adjustment target attribute on thebasis of the touch input (S3650). The controller 3500 of thepointing-device-integrated text input device 3000 may generate anattribute adjustment input on the basis of a touch coordinate value andmay deliver the generated attribute adjustment input to an entity thatuses the pointing-device-integrated text input device 3000 as an inputinterface.

FIG. 68 is a flowchart showing another example in which thepointing-device-integrated text input device 3000 adjusts an adjustmenttarget attribute.

Referring to FIG. 68 , the method may include acquiring a key identifieraccording to a push input (S3710), determining a mode (S3720), acquiringa character value corresponding to the key identifier (S3730),determining a key value to which an adjustment target attribute isallocated (S3740), acquiring a touch input (S3750), and adjusting theadjustment target attribute on the basis of the touch input (S3760).

The above-described steps will be described in detail below.

The pointing-device-integrated text input device 3000 may acquire a keyidentifier according to a push input (S3710). In detail, the controller3500 may receive the key identifier from the switch 3200 that receivedthe push input.

Next, the pointing-device-integrated text input device 3000 maydetermine a mode (S3720). In detail, the controller 3500 may determinewhether the current mode is the touch mode or the keyboard mode.

When the current mode is the keyboard mode, thepointing-device-integrated text input device 3000 may acquire acharacter value corresponding to the key identifier as a key value(S3730). The key value may be delivered to an electronic device in theform of a keyboard input and used for text input.

When the current mode is the touch mode, the pointing-device-integratedtext input device 3000 may acquire an adjustment target attributeallocated to the key identifier (S3740). On the basis of a touch inputthat is subsequently acquired (S3750), the pointing-device-integratedtext input device 3000 may adjust an attribute value of the adjustmenttarget attribute (S3760). The adjustment of the attribute value may beperformed by the pointing-device-integrated text input device 3000generating an attribute adjustment input by means of a touch coordinatevalue of the touch input and delivering the generated attributeadjustment input to the electronic device.

FIG. 69 is a flowchart showing still another example in which thepointing-device-integrated text input device 3000 adjusts an adjustmenttarget attribute.

Referring to FIG. 69 , the method may include acquiring a push inputindicating an adjustment target attribute (S3810), acquiring a touchinput (S3820), calculating a touch coordinate value (S3830), correctingthe touch coordinate value on the basis of an adjustment direction ofthe adjustment target attribute (S3840), and adjusting the adjustmenttarget attribute according to the corrected touch coordinate value(S3850).

The above-described steps will be described in detail below.

The pointing-device-integrated text input device 3000 may acquire a pushinput indicating an adjustment target attribute (S3810) and acquire asubsequent touch input (S3820). The controller 3500 may calculate atouch coordinate value (S3830).

Next, the pointing-device-integrated text input device 3000 may correctthe touch coordinate value on the basis of an adjustment direction ofthe adjustment target attribute (S3840). Generally, the touch input isrepresented as a 2D touch coordinate value. When the adjustment targetattribute has a 1D attribute value, the controller 3500 may correct thetouch coordinate value as a 1D coordinate value according to theadjustment direction of the adjustment target attribute.

When the touch coordinate value is corrected, thepointing-device-integrated text input device 3000 may adjust theadjustment target attribute according to the corrected touch coordinatevalue (S3850). The adjustment of the adjustment target attribute may beperformed by the controller 3500 generating an attribute adjustmentinput according to the corrected touch coordinate value and deliveringthe generated attribute adjustment input to an electrode device, and bythe electronic device adjusting an attribute value of the adjustmenttarget attribute according to the attribute adjustment input.

FIG. 70 is a flowchart showing still another example in which thepointing-device-integrated text input device 3000 adjusts an adjustmenttarget attribute.

Referring to FIG. 70 , the method may include acquiring a push inputindicating an adjustment target attribute (S3910), calculating a touchcoordinate value of a start touch input (S3920), acquiring a matchingrelationship between a current attribute value of the adjustment targetattribute and the touch coordinate value of the start touch input(S3930), and adjusting the attribute value of the adjustment targetattribute according to the touch input in consideration of the matchingrelationship (S3940).

The above-described steps will be described in detail below.

The pointing-device-integrated text input device 3000 may acquire a pushinput indicating an adjustment target attribute (S3910) and acquire astart touch input.

When the start touch input is acquired, the pointing-device-integratedtext input device 3000 may calculate a start touch coordinate value(S3920).

Next, the pointing-device-integrated text input device 3000 may generatea matching relationship between a current attribute value of theadjustment target attribute and a touch coordinate value of the starttouch input (S3930). The controller 3500 may acquire the currentattribute value and generate a table or function that matches theacquired attribute value and the start touch coordinate value.

When the matching relationship is generated, thepointing-device-integrated text input device 3000 may adjust anattribute value of the adjustment target attribute according to thetouch input in consideration of the matching relationship (S3940).

Here, the matching relationship does not have to be set. Instead offorming the matching relationship, the pointing-device-integrated textinput device 3000 may generate an attribute adjustment input on thebasis of a difference value between the touch coordinate value of thestart touch input and a subsequent touch coordinate value. Since thepointing-device-integrated text input device 3000 calculates a touchcoordinate variation according to a difference between a current touchcoordinate value and the start touch coordinate value instead ofperforming a difference operation of a touch coordinate value for eachperiod of a scan signal, the same effect as that obtained bysubstantially forming a matching relationship and matching the currenttouch coordinate value to the attribute value may be obtained.

FIG. 71 is a flowchart showing still another example in which thepointing-device-integrated text input device 3000 adjusts an adjustmenttarget attribute.

Referring to FIG. 71 , the method may include acquiring a push inputindicating an adjustment target attribute (S4010), acquiring a matchingrelationship between a touch region and a range of the adjustment targetattribute (S4020), and adjusting an attribute value of the adjustmenttarget attribute according to a touch input in consideration of thematching relationship (4030).

The above-described steps will be described in detail below.

The pointing-device-integrated text input device 3000 may acquire a pushinput indicating an adjustment target attribute (S4010) and set a touchregion.

In this case, the pointing-device-integrated text input device 3000 mayacquire a matching relationship between the touch region and a range ofthe adjustment target attribute (S4020). For example, when theadjustment target attribute has a 1D attribute value, the controller3500 may generate a matching relationship such that a maximum value anda minimum value of the attribute value are matched to an upper side anda lower side or a left side and a right side of a touch region, and mayset the touch region. As another example, when the adjustment targetattribute has a 2D attribute value, the controller 3500 may match amaximum value and a minimum value of any one of two attribute values tothe upper side and the lower side of the touch region and also match amaximum value and a minimum value of the other one of the two attributevalues to the left side and the right side of the touch region. Here, itshould be appreciated that the touch region does not have to be set asthe entire touchable region.

The pointing-device-integrated text input device 3000 may adjust anattribute value of the adjustment target attribute according to a touchinput in consideration of the matching relationship (S4030). This hasbeen described above, and thus a detailed description thereof will beomitted.

In this description, the pointing-device-integrated text input device3000 may detect a hovering input in addition to a key input and a touchinput. Here, the hovering input may refer to an input in which a user'sfinger or body part is positioned in the vicinity of an upper portion ofthe button 3100 unlike a touch input in which the button 3100 isdirectly touched. Hereinafter, the touch input and the hovering inputare collectively referred to as a gesture input.

FIG. 72 is an example of a hovering input of thepointing-device-integrated text input device 3000 of FIG. 30 .

In this description, the pointing-device-integrated text input device3000 may detect a touch input by means of a change in capacitance of theelectrode 3130 included in the button 3100 according to a user's touchinput. Here, when the user's body part (e.g., a finger) is located overthe button 3100, the capacitance of the electrode 3130 included in thebutton 3100 may change, but the amount of change is smaller than that ofthe touch input. The controller 3500 may acquire the amount of changethrough a scan signal to process the amount of change as a hoveringinput.

Referring to FIG. 72 , it can be seen that a large change in capacitanceoccurs even when a hovering input is input although the amount of changeis smaller than the amount of change in capacitance generated by a touchinput.

In particular, depending on cases, the controller 3500 may sense adistance from a keyboard surface to the user's body part in a directionperpendicular to the keyboard layout as well as a horizontal position ofthe hovering input according to the amount of change in capacitance.

That is, the controller 3500 may calculate a value (x, y) on the basisof a scan signal reflecting the change in capacitance like that of atouch input. Further, when the change in capacitance is a predeterminedthreshold or more smaller than a change in capacitance occurring duringinput of a touch input, the controller 3500 may determine that thechange is a hovering input. Also, when it is determined that thehovering input is applied, the controller 3500 may further calculate az-value (a hovering coordinate value perpendicular to the keyboardlayout) on the basis of the amount of change in capacitance.

In detail, the controller 3500 may detect a touch input when the amountof change in capacitance is greater than a touch input threshold, andmay detect a hovering input when the amount of change in capacitance isboth the touch input threshold or less and a hovering input threshold ormore.

As shown in FIG. 72 , when the electrode 3130 is touched with a finger,the amount of change in capacitance is a touch threshold value or more,and the pointing-device-integrated text input device 3000 may detect thetouch as a touch input. For a second hand and a third hand each having afinger located a predetermined distance from the electrode 3130 in FIG.72 , the amount of change in capacitance is a hovering threshold valueor more, and thus the pointing-device-integrated text input device 3000may detect such changes as a hovering input.

Also, when a finger is far from the electrode 3130 such that a change incapacitance of the hovering threshold value or less is detected, thepointing-device-integrated text input device 3000 may process the changeas no input.

In this description, the pointing-device-integrated text input device3000 may control a plurality of electronic devices 20.

FIG. 73 is an example of a multi-device environment using thepointing-device-integrated text input device 3000 of FIG. 30 .

Referring to FIG. 73 , the pointing-device-integrated text input device3000 may control a first electronic device 21, a second electronicdevice 22, and a third electronic device 23. Here, the first to thirdelectronic devices are electronic devices that are configured toindependently control a display, and are thus configured to control anindependently operating pointer P on the screen 10. Here, all of theelectronic devices 20 may be electronic devices that are separate fromthe pointing-device-integrated text input device 3000, or any one of theelectronic devices 20 may be an electronic device in which thepointing-device-integrated text input device 3000 is embedded. In thefollowing description, for convenience of description, the firstelectronic device 21 and the third electronic device 23 are elementsthat are separate from the pointing-device-integrated text input device3000, and the second electronic device 22 is provided integrally withthe pointing-device-integrated text input device 3000. However, itshould be noted that the multi-device environment is not limited theretoin this description.

Referring back to FIG. 73 , the pointing-device-integrated text inputdevice 3000 may operate as an input interface for any one of theplurality of electronic devices 20. For example, thepointing-device-integrated text input device 3000 may operate as aninput interface for an electronic device that has the firstcommunication connection established with the pointing-device-integratedtext input device 3000 among the plurality of electronic devices 20.When the second electronic device 22 is a notebook in which thepointing-device-integrated text input device 3000 is embedded, thepointing-device-integrated text input device 3000 may operate as aninput interface for the second electronic device 22 by default.

In this case, the pointing-device-integrated text input device 3000acquires a mouse input, a digitizer input, or a keyboard input in thetouch mode or the keyboard mode, and transmits the acquired input to thesecond electronic device 22. The second electronic device may move thepointer P or perform a character input on the screen 10 provided by adisplay connected to the second electronic device 22 on the basis ofdata delivered from the pointing-device-integrated text input device3000. That is, the pointing-device-integrated text input device 3000functions as an input interface for the second electronic device.

In this case, the pointing-device-integrated text input device 3000 maydetect a hovering input.

FIG. 74 is a diagram showing an example of selecting a control targetdevice by using a hovering input in the multi-device environment of FIG.70 .

Referring to FIG. 74 , the pointing-device-integrated text input device3000 may input a hovering input in the touch mode. However, recognitionof a hovering input in the touch mode may cause inconvenience in a touchoperation. Accordingly, when necessary, the pointing-device-integratedtext input device 3000 may additionally have a hovering mode andrecognize a hovering input after entering the hovering mode.

When the hovering mode is entered, the pointing-device-integrated textinput device 3000 receives a hovering input, detects whether thehovering input is received on the basis of a change in capacitancegenerated in the electrode 3130, and acquires a hovering planecoordinate value (x, y) corresponding to the hovering input. It shouldbe appreciated that a hovering height coordinate value in a z-axisdirection may be further acquired.

When the hovering coordinate value is acquired, thepointing-device-integrated text input device 3000 may calculate aposition of a virtual 3D pointer P according to the hovering coordinate.While the touch coordinate value of the touch input indicates movementof a pointer P in a screen 10 provided by a display of an electronicdevice coupled with the pointing-device-integrated text input device3000, the hovering coordinate value of the hovering input may be used toselect the plurality of electronic devices 20 capable of connecting tothe pointing-device-integrated text input device 3000.

In detail, referring back to FIG. 74 , first, thepointing-device-integrated text input device 3000 operates as an inputinterface of the second electronic device 22. In this case, a touchinput between a seventh touch input L5 and an eighth touch input L6 maybe used as an input for controlling a pointer P of the second electronicdevice 22 to move the pointer of the second electronic device 22 from aseventh position D5 to an eighth position D6 on a screen of acorresponding device.

In this situation, a hovering input may be performed after the eighthtouch input L6. The hovering input may be composed of the eighthhovering input L6 and a ninth hovering input L7. Thepointing-device-integrated text input device 3000 may sense such ahovering input and move the pointer P from a spatial positioncorresponding to the eighth position D6 in a 3D space to a spatialposition corresponding to the ninth position D7 in a virtual space.

Here, the spatial position corresponding to the eighth position D6 is aposition indicating the second electronic device 22, and the spatialposition corresponding to the ninth position D7 is a position indicatingthe third electronic device 23.

When a touch input is generated while the 3D pointer is located at theposition indicating the third electronic device 23, thepointing-device-integrated text input device 3000 may change a controldevice to an electronic device currently indicated by the 3D pointer,that is, the third electronic device 23.

Thus, the pointing-device-integrated text input device 3000 operates asan input interface for the third electronic device 23. Accordingly, asubsequent touch input, that is, a touch input composed of the ninthtouch input L7 and a tenth touch input L10, may be used to operate apointer of the third electronic device 23 and may be used to move thepointer from the ninth position D7 to a tenth position D8 on a screen ofthe third electronic device 23.

The hovering region 3020 may be divided into a plurality of sub-regions.In this case, the controller 3500 may check the number of nearbyelectronic devices capable of connecting with thepointing-device-integrated text input device 3000 in a wired/wirelessmanner, and may divide the hovering region 3020 into as many sub-regionsas the number of electronic devices or a maximum number of sub-regions.Also, the sub-regions may correspond to the plurality of electronicdevices 20.

FIG. 75 is a diagram showing another example of selecting a controltarget device by using a hovering input in the multi-device environmentof FIG. 70 .

Referring to FIG. 75 , as an example, in a multi-device environment withtwo devices, a hovering region of the pointing-device-integrated textinput device 3000 may include a first region 3010 a′ and a second region3010 a″. Here, the first region 3010 a′ may be a region indicating thefirst electronic device 21, and the second region 3010 a″ may be aregion indicating the second electronic device 22.

When the pointing-device-integrated text input device 3000 enters thehovering mode (or an electronic control device selection mode), thecontroller 3500 may detect a hovering input and may calculate a hoveringcoordinate value. When the hovering input moves in the hovering region3020, the controller 3500 may track the hovering input in real time.When a touch input is generated by bringing a user's body part intocontact with a touch region during the hovering input, the electronicdevice 20 allocated to the hovering region 3020 corresponding to thetouch region in which the touch input is generated may be selected as acontrol target device.

Subsequently, the pointing-device-integrated text input device 3000operates as an input interface for the electronic device selected as thecontrol target device. That is, when a keyboard input or a touch inputis recognized, the pointing-device-integrated text input device 3000 maydeliver a corresponding key value, character value, mouse input, orpiece of touch information to the control target device.

Additionally, in this description, the pointing-device-integrated textinput device 3000 may be connected with an AR device or a VR device toacquire a hovering input for controlling the pointer P′ in a 3D spacedisplayed in AR or VR.

FIG. 76 is a diagram showing still another example of selecting acontrol target device by using a hovering input in the multi-deviceenvironment of FIG. 70 .

In this example, the hovering region 3020 is set in thepointing-device-integrated text input device 3000 and is matched to a 3Dspace in VR or AR provided by an HMD or the like.

The pointing-device-integrated text input device 3000 may calculate ahovering coordinate value according to a hovering input and may transmitthe calculated hovering coordinate value to the HMD or an electronicdevice that controls the HMD. The electronic device may control aposition of the pointer P in the 3D space by using the hoveringcoordinate value.

Here, when the pointer P is located at a position indicating one of theplurality of electronic devices 20 connectable with thepointing-device-integrated text input device 3000, thepointing-device-integrated text input device 3000 may receive a touchinput or a pointer execution command for a touch region. In this case,the pointing-device-integrated text input device 3000 may select theelectronic device 20 corresponding to the corresponding position as acontrol target device and operate as an input device for the controltarget device.

A VR or AR providing device such as an HMD may provide a virtual graphicobject in a virtual space or an augmented space.

In FIG. 76 , an AR object 24 may be displayed by the HMD. In thissituation, when a touch input is received after a virtual pointer P′ ismoved to a position at which an AR/VR object is located through ahovering input of the pointing-device-integrated text input device 3000,the pointing-device-integrated text input device 3000 may select theobject indicated by the virtual pointer P′ as a control target object.

A subsequent touch input or keyboard input may be used to move a cursoror pointer included in the control target object or deliver a keyboardinput to the control target object.

FIG. 77 is a flowchart showing an example in which thepointing-device-integrated text input device 3000 controls multipledevices.

Referring to FIG. 77 , the method may include acquiring a hovering input(S4110), calculating hovering coordinates (S4120), controlling aposition of a virtual pointer in a 3D space according to the hoveringcoordinates (S4130), selecting a control target device on the basis ofthe position of the virtual pointer when the hovering input ends(S4140), acquiring a touch input (S4150), and controlling a position ofa pointer on a screen of the control target device according to thetouch input (S4160).

The above-described steps will be described in detail below.

The pointing-device-integrated text input device 3000 may acquire ahovering input (S4110). In this case, when a change in capacitance ofthe electrode 3130 is generated by a user input, the controller 3500 maydetermine whether the user input is a touch input or a hovering inputaccording to the amount of change in capacitance.

When the hovering input is acquired, the pointing-device-integrated textinput device 3000 may calculate hovering coordinates (S4120). Among thehovering coordinates, a coordinate value (x, y) may be calculated in asimilar way to that of a touch coordinate value. Also, among thehovering coordinates, a z coordinate value may be calculated on thebasis of the amount of change in capacitance. However, the z coordinatevalue among the hovering coordinates is not necessarily calculated.

The pointing-device-integrated text input device 3000 may control aposition of a virtual pointer in a 3D space according to the hoveringcoordinates (S4130). Here, a plurality of devices may be disposed in avirtual space.

The pointing-device-integrated text input device 3000 may select acontrol target device on the basis of the position of the virtualpointer when the hovering input ends (S4130). Here, the end of thehovering input may refer to a case in which a touch input is generatedor a case in which the change in capacitance is a hovering threshold orless because a finger is sufficiently far from thepointing-device-integrated text input device 3000. However, a selectionof the control target device determined by a touch input on a UI may bemore consistent with the user's intention.

When the hovering input ends, the controller may select a deviceselected by the virtual pointer as a control target device at a timepoint at which the hovering input ends. When the control target deviceis selected, the pointing-device-integrated text input device 3000 mayoperate as an input interface of the corresponding control targetdevice.

Here, when the hovering input ends while the virtual pointer indicates aVR/AR object, the pointing-device-integrated text input device 3000 mayoperate an input interface for the corresponding object.

Subsequently, the pointing-device-integrated text input device 3000 mayacquire a touch input or a keyboard input (S4140), and thus may controla position of a pointer on a screen of the control target device orperform a text input on the screen (S4150).

The above-described methods according to embodiments of the presentinvention may be used alone or in combination. Not all of the stepsdescribed in the methods according to embodiments of the presentinvention are necessary, and thus each method may include all or onlysome of the steps. Also, since the orders in which the steps aredescribed are merely for convenience of description, the steps in themethods described in the present invention do not necessarily have toproceed in the described orders.

The above description is simply for the purpose of illustrativelydescribing the technical spirit of the present invention, and variousmodifications and changes may be made to the embodiments by thoseskilled in the art without departing from the essential characteristicsof the present invention.

Accordingly, the embodiments of the present invention may be implementedseparately or in combination.

Accordingly, the embodiments of the present invention are to beconsidered descriptive and not restrictive of the present invention, anddo not limit the scope of the present invention. The scope of theinvention should be construed by the appended claims, and the technicalspirit within the scope of their equivalents should be construed asincluded in the scope of the invention.

MODE OF INVENTION

As described above, associated details are provided in the detaileddescription of the embodiments.

INDUSTRIAL APPLICABILITY

As described above, the present invention may be entirely or partiallyapplied to an electronic device that uses a multi-functional humaninterface device including a text input device and a pointer locationinformation input device.

The invention claimed is:
 1. An electronic device having amulti-function human interface, the electronic device comprising: a textarea for receiving a text input from a user to generate a text inputsignal, wherein the text area; a touch area for receiving a touch inputfrom the user to generate a pointer-position signal, wherein the toucharea is overlapped with at least part of the text area; and amulti-functional area disposed in a region where the text area and thetouch area are overlapped as viewed from above, wherein themultifunctional area comprises: a plurality of covers configured to bemoved downward by pressure for generating the text input signal; aplurality of first type lines disposed along a length direction of thetouch area, wherein the plurality of first type lines compriseelectrodes which are connected in the length direction; and a pluralityof second type lines disposed along a width direction of the touch area,wherein the plurality of second type lines comprise electrodes which areconnected in the width direction, wherein the plurality of first typelines are functioned as one of transmitter line and receiver line, andthe plurality of second type lines are functioned as the other oftransmitter line and receiver line, wherein the plurality of coverscomprise at least a first cover, a second cover and a third cover,wherein the second cover is located adjacent to the first cover in thewidth direction, wherein the third cover is located adjacent to thefirst cover in the width direction, and wherein the second cover and thethird cover are not adjacent to each other, wherein the plurality ofsecond type lines comprise at least a first line, a second line and athird line, wherein the first line is overlapped with the first coverand the second cover while non-overlapped with the third cover, whereinthe second line is overlapped with the first cover and the third coverwhile non-overlapped with the second cover, and wherein the third lineis located between the first line and the second line and is overlappedwith the first cover, second cover and the third cover.
 2. Theelectronic device of claim 1, wherein the multifunctional area furthercomprises a plurality of elastic bodies, wherein each of the pluralityof elastic bodies is located corresponding to each of the plurality ofcovers.
 3. The electronic device of claim 2, wherein the plurality ofelastic bodies are located between plurality of covers and the pluralityof first and second type lines.
 4. The electronic device of claim 1,wherein a part of electrodes of the first line are overlapped with thefirst cover and the second cover, and wherein a part of electrodes ofthe second line are overlapped with the first cover and the third cover.5. The electronic device of claim 1, wherein a first portion ofelectrodes of the first line is located under the first cover and asecond portion of electrodes of the first line are located under thesecond cover, and wherein a first portion of electrodes of the secondline is located under the first cover and a second portion of electrodesof the second lines is located under the third cover.
 6. The electronicdevice of claim 1, wherein the text input signal is generated when thecover is moved downward.
 7. The electronic device of claim 1, whereinthe text input signal is generated when it is detected that the cover ismoved downward.
 8. The electronic device of claim 1, wherein themulti-functional area further comprises a plurality of switchesconfigured to detect whether a corresponding cover is moved downward bya predetermined distance.
 9. The electronic device of claim 1, wherein afirst line of the plurality of second type lines is overlapped with thefirst key cover and is not overlapped with the second and third keycovers, wherein a second line of the plurality of second type lines isoverlapped with the second key cover and is not overlapped with thefirst and third key covers, and wherein a third line of the plurality ofsecond type lines is overlapped with the third key cover and is notoverlapped with the first and second key covers.
 10. The electronicdevice of claim 1, wherein at least a part of electrodes which theplurality of second type lines comprises are attached to a back surfaceof the first key cover, and wherein at least other part of electrodeswhich the plurality of second type lines comprises are attached to aback surface of the second key cover.
 11. The electronic device of claim10, wherein a height of a first plane where the at least a part ofelectrodes which attached to the first key cover are positioned aredifferent from a height of a second plane where the at least other partof electrodes which attached to the second key cover are positioned whenthe first key cover is moved down by the pressure.
 12. The electronicdevice of claim 11, wherein the multifunctional area further comprisesan electrical connection member, and wherein the electrical connectionmember is configured to connect, when the key first key cover is moveddown by the pressure, the at least a part of electrodes which areattached to the first key cover and the at least other part ofelectrodes which are attached to the second key cover.
 13. Theelectronic device of claim 12, wherein the electrical connection memberis printed on a flexible circuit board with the at least a part ofelectrodes which are attached to the first key cover.
 14. The electronicdevice of claim 12, wherein the electrical connection member isseparatable from the at least a part of electrodes which are attached tothe first key cover, and wherein the electrical connection member iselectrically connected to the at least a part of electrodes which areattached to the first key cover by contact.
 15. The electronic device ofclaim 12, wherein the electrical connection member is configured to beelectrically connected to the at least a part of electrodes which areattached to the first key cover without a physical contact.
 16. Theelectronic device of claim 1, wherein one electrode which the pluralityof second type lines comprises and is overlapped with the first andsecond key covers comprises a first region which is overlapped with thefirst key cover and a second region which is overlapped with the secondkey cover.
 17. The electronic device of claim 16, wherein there exists aregion between the first region and the second region, the region beingnot overlapped with the first and second key covers.
 18. The electronicdevice of claim 16, wherein the multifunctional area further comprisesan electrical connection member, and wherein the electrical connectionmember is configured to connect the first region and the second region.